Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ tags:
|
|
| 12 |
|
| 13 |
# Current Versions:
|
| 14 |
- **Freedream_1B-7b-tokens-seen:** This is an early trained model, that only see total of 7Billion tokens, it is a base model that has a moderate performance that can generate fluence text but contains factual error. Don't recommend for code or hard maths reasoning.
|
| 15 |
-
- **Freedream_1B-20b-tokens-seen** This is the version that approximately reaches the Chinchilla optimal of 1B parameter : 20 billions of tokens, the model has a generally good performance that improved from the 7-billion-tokens-seen version on more accurate facts and better logic when generating. The final loss is around 2.6.
|
| 16 |
------------------------------------------------------
|
| 17 |
|
| 18 |
## Reserved Name & Trademark Notice
|
|
|
|
| 12 |
|
| 13 |
# Current Versions:
|
| 14 |
- **Freedream_1B-7b-tokens-seen:** This is an early trained model, that only see total of 7Billion tokens, it is a base model that has a moderate performance that can generate fluence text but contains factual error. Don't recommend for code or hard maths reasoning.
|
| 15 |
+
- **Freedream_1B-20b-tokens-seen:** This is the version that approximately reaches the Chinchilla optimal of 1B parameter : 20 billions of tokens, the model has a generally good performance that improved from the 7-billion-tokens-seen version on more accurate facts and better logic when generating. The final loss is around 2.6.
|
| 16 |
------------------------------------------------------
|
| 17 |
|
| 18 |
## Reserved Name & Trademark Notice
|