basecompute
/

Mistral-7B-Instruct-v0.3

Text Generation

basert

apple-silicon

quantized

Model card Files Files and versions

xet

Community

Mistral-7B-Instruct-v0.3

11.7 GB

Ctrl+K

1 contributor

History: 7 commits

prabodbc

Re-convert with fixed rotary q/k permutation (baseRT-internal#114); NIAH-validated at 2k/8k. Q4 now uses the default-q4 quality profile (embeddings/head at higher precision).

3805d32 verified 16 days ago