appvoid commited on
Commit
9151972
·
verified ·
1 Parent(s): 36f9691

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -37,7 +37,7 @@ State of the art, small language model pretrained from scratch on a diverse set
37
  ## Details
38
 
39
 
40
- We used the revision on step 900,000 for evaluations which trained for ~12 days on a single RTX PRO 6000 gpu. It trained on 131.69 billion bytes which is between 32.92B and 43.90B standard tokens, around ~38 billion bpe tokens on average. For more details on the evals and inference, please have a look at the [official notebook](https://huggingface.co/dotlabs/void.1/blob/main/evals.ipynb). For training details, chech the [training config file](https://huggingface.co/dotlabs/void.1/blob/main/training_config.json)
41
  ```bibtex
42
  @misc{dotlabs,
43
  title = {void: bytes is all you need},
 
37
  ## Details
38
 
39
 
40
+ We used the revision on step 900,000 for evaluations which trained for ~12 days on a single RTX PRO 6000 gpu. It trained on 131.69 billion bytes which is between 32.92B and 43.90B standard tokens, around ~38 billion bpe tokens on average. For more details on the evals and inference, please have a look at the [official notebook](https://huggingface.co/dotlabs/void.1/blob/main/evals.ipynb). For exact training details, please check the [training config file](https://huggingface.co/dotlabs/void.1/blob/main/training_config.json).
41
  ```bibtex
42
  @misc{dotlabs,
43
  title = {void: bytes is all you need},