Digilidaahz commited on
Commit
6533279
·
verified ·
1 Parent(s): 03d06d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ tags:
12
 
13
  # Current Versions:
14
  - **Freedream_1B-7b-tokens-seen:** This is an early trained model, that only see total of 7Billion tokens, it is a base model that has a moderate performance that can generate fluence text but contains factual error. Don't recommend for code or hard maths reasoning.
15
- - **Freedream_1B-20b-tokens-seen** This is the version that approximately reaches the Chinchilla optimal of 1B parameter : 20 billions of tokens, the model has a generally good performance that improved from the 7-billion-tokens-seen version on more accurate facts and better logic when generating. The final loss is around 2.6.
16
  ------------------------------------------------------
17
 
18
  ## Reserved Name & Trademark Notice
 
12
 
13
  # Current Versions:
14
  - **Freedream_1B-7b-tokens-seen:** This is an early trained model, that only see total of 7Billion tokens, it is a base model that has a moderate performance that can generate fluence text but contains factual error. Don't recommend for code or hard maths reasoning.
15
+ - **Freedream_1B-20b-tokens-seen:** This is the version that approximately reaches the Chinchilla optimal of 1B parameter : 20 billions of tokens, the model has a generally good performance that improved from the 7-billion-tokens-seen version on more accurate facts and better logic when generating. The final loss is around 2.6.
16
  ------------------------------------------------------
17
 
18
  ## Reserved Name & Trademark Notice