Commit ·
bebf90d
1
Parent(s): bcdd6af
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,9 @@ tags:
|
|
| 14 |
- custom_code
|
| 15 |
- fp16
|
| 16 |
- base
|
|
|
|
|
|
|
|
|
|
| 17 |
---
|
| 18 |
|
| 19 |
# KenT-30M-Base
|
|
@@ -63,4 +66,4 @@ Long documents: `python infer.py --model ./KenT-30M-Base --prompt-file doc.txt -
|
|
| 63 |
## Notes
|
| 64 |
|
| 65 |
- Research model, trained from scratch; evaluate before real-world use.
|
| 66 |
-
- The tokenizer and weights must match `vocab_size` in `config.json`.
|
|
|
|
| 14 |
- custom_code
|
| 15 |
- fp16
|
| 16 |
- base
|
| 17 |
+
datasets:
|
| 18 |
+
- wikimedia/wikipedia
|
| 19 |
+
- HuggingFaceFW/fineweb-edu
|
| 20 |
---
|
| 21 |
|
| 22 |
# KenT-30M-Base
|
|
|
|
| 66 |
## Notes
|
| 67 |
|
| 68 |
- Research model, trained from scratch; evaluate before real-world use.
|
| 69 |
+
- The tokenizer and weights must match `vocab_size` in `config.json`.
|