Model Card for Model ID

This is a GPTQ quantized version of https://huggingface.co/amd/Instella-3B-Instruct

Results

Benchmark Score
MMLU 57.13
TruthfulQA 55.23
Downloads last month
6
Safetensors
Model size
3B params
Tensor type
I32
ยท
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support