How to use from
Docker Model Runner
docker model run hf.co/AlexWortega/smallstral
Quick Links

Smallstral, layer pruned Mistral

Task Metric Mistral-7B-v0.1 Value Smallstral Value
hendrycksTestRu-high_school_mathematics acc 0.3037 0.2852
hendrycksTestRu-high_school_microeconomics acc 0.3950 0.3319
hendrycksTestRu-high_school_physics acc 0.3113 0.2649
hendrycksTestRu-high_school_psychology acc 0.5193 0.1945
hendrycksTestRu-high_school_statistics acc 0.3241 0.4028
hendrycksTestRu-high_school_us_history acc 0.5392 0.2451
hendrycksTestRu-high_school_world_history acc 0.5781 0.2321
hendrycksTestRu-human_aging acc 0.4843 0.3184
parus acc 0.5000 0.4875
rcb acc 0.3653 0.3288
rcb f1_macro 0.3313 0.1691
rwsd acc 0.4917 0.4901
Downloads last month
15
Safetensors
Model size
2B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support