Update README.md
Browse files
README.md
CHANGED
|
@@ -15,4 +15,6 @@ A 59M parameters model with Deepseek V4.1 Flash architechture
|
|
| 15 |
Other formats:
|
| 16 |
- GGUF: https://huggingface.co/LocalWisdom/Penny-Alpha-GGUF
|
| 17 |
|
| 18 |
-
Trained on 1B tokens of Ultra-FineWeb-L3 over 1 day 12 hours using 1x RTX 5060 Ti costing us $5.64.
|
|
|
|
|
|
|
|
|
| 15 |
Other formats:
|
| 16 |
- GGUF: https://huggingface.co/LocalWisdom/Penny-Alpha-GGUF
|
| 17 |
|
| 18 |
+
Trained on 1B tokens of Ultra-FineWeb-L3 over 1 day 12 hours using 1x RTX 5060 Ti costing us $5.64.
|
| 19 |
+
|
| 20 |
+
Official context window is 8192 tokens. However, the model's native context window is 1M tokens. Tokens above 8192 has never been trained.
|