Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ealexeev
/
Mistral-Small-24B-NVFP4
Like
0
Text Generation
Safetensors
HuggingFaceH4/ultrachat_200k
mistral
quantization
vllm
nvfp4
conversational
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Mistral-Small-24B-NVFP4
15.2 GB
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
ealexeev
Update README.md
071bfc1
verified
10 months ago
.gitattributes
Safe
1.57 kB
Initial upload of NVFP4 quantized model
10 months ago
README.md
Safe
999 Bytes
Update README.md
10 months ago
chat_template.jinja
Safe
1.6 kB
Initial upload of NVFP4 quantized model
10 months ago
config.json
Safe
1.81 kB
Initial upload of NVFP4 quantized model
10 months ago
generation_config.json
Safe
155 Bytes
Initial upload of NVFP4 quantized model
10 months ago
model-00001-of-00004.safetensors
5 GB
xet
Initial upload of NVFP4 quantized model
10 months ago
model-00002-of-00004.safetensors
4.99 GB
xet
Initial upload of NVFP4 quantized model
10 months ago
model-00003-of-00004.safetensors
3.86 GB
xet
Initial upload of NVFP4 quantized model
10 months ago
model-00004-of-00004.safetensors
1.34 GB
xet
Initial upload of NVFP4 quantized model
10 months ago
model.safetensors.index.json
Safe
109 kB
Initial upload of NVFP4 quantized model
10 months ago
recipe.yaml
Safe
130 Bytes
Initial upload of NVFP4 quantized model
10 months ago
special_tokens_map.json
Safe
21.3 kB
Initial upload of NVFP4 quantized model
10 months ago
tokenizer.json
Safe
17.1 MB
xet
Initial upload of NVFP4 quantized model
10 months ago
tokenizer_config.json
Safe
198 kB
Initial upload of NVFP4 quantized model
10 months ago
