Penny Alpha

A 59M parameters model with Deepseek V4.1 Flash architechture

Other formats:

Trained on 1B tokens of Ultra-FineWeb-L3 over 1 day 12 hours using 1x RTX 5060 Ti costing us $5.64.

Official context window is 8192 tokens. However, the model's native context window is 1M tokens. Tokens above 8192 has never been trained.

Downloads last month
-
Safetensors
Model size
58.9M params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for LocalWisdom/Penny-Alpha

Quantizations
1 model

Dataset used to train LocalWisdom/Penny-Alpha

Collection including LocalWisdom/Penny-Alpha