How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="AlexWortega/smallstral")
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("AlexWortega/smallstral")
model = AutoModelForCausalLM.from_pretrained("AlexWortega/smallstral", device_map="auto")
Quick Links

Smallstral, layer pruned Mistral

Task Metric Mistral-7B-v0.1 Value Smallstral Value
hendrycksTestRu-high_school_mathematics acc 0.3037 0.2852
hendrycksTestRu-high_school_microeconomics acc 0.3950 0.3319
hendrycksTestRu-high_school_physics acc 0.3113 0.2649
hendrycksTestRu-high_school_psychology acc 0.5193 0.1945
hendrycksTestRu-high_school_statistics acc 0.3241 0.4028
hendrycksTestRu-high_school_us_history acc 0.5392 0.2451
hendrycksTestRu-high_school_world_history acc 0.5781 0.2321
hendrycksTestRu-human_aging acc 0.4843 0.3184
parus acc 0.5000 0.4875
rcb acc 0.3653 0.3288
rcb f1_macro 0.3313 0.1691
rwsd acc 0.4917 0.4901
Downloads last month
15
Safetensors
Model size
2B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support