RedHatAI
/

Mistral-Small-24B-Instruct-2501-quantized.w8a8

Text Generation

text-generation-inference

compressed-tensors

8-bit precision

Model card Files Files and versions

Mistral-Small-24B-Instruct-2501-quantized.w8a8

25 GB

Ctrl+K

Ctrl+K

3 contributors

History: 13 commits

robgreenberg3's picture

Update README.md

bac3f41 verified about 2 months ago

.gitattributes

1.62 kB
Upload tekken.json 9 months ago
README.md

13.6 kB
Update README.md about 2 months ago
config.json

1.75 kB
Upload folder using huggingface_hub over 1 year ago
generation_config.json

155 Bytes
Upload folder using huggingface_hub over 1 year ago
model-00001-of-00006.safetensors

4.9 GB
xet

Upload folder using huggingface_hub over 1 year ago
model-00002-of-00006.safetensors

4.84 GB
xet

Upload folder using huggingface_hub over 1 year ago
model-00003-of-00006.safetensors

4.98 GB
xet

Upload folder using huggingface_hub over 1 year ago
model-00004-of-00006.safetensors

5 GB
xet

Upload folder using huggingface_hub over 1 year ago
model-00005-of-00006.safetensors

3.87 GB
xet

Upload folder using huggingface_hub over 1 year ago
model-00006-of-00006.safetensors

1.34 GB
xet

Upload folder using huggingface_hub over 1 year ago
model.safetensors.index.json

54.3 kB
Upload folder using huggingface_hub over 1 year ago
recipe.yaml

709 Bytes
Upload folder using huggingface_hub over 1 year ago
special_tokens_map.json

21.3 kB
Upload folder using huggingface_hub over 1 year ago
tekken.json

14.8 MB
xet

Upload tekken.json 9 months ago
tokenizer.json

17.1 MB
xet

Upload folder using huggingface_hub over 1 year ago
tokenizer_config.json

200 kB
Upload folder using huggingface_hub over 1 year ago