PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M
12B • Updated • 15
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
18,261
Active filters: quantized
sdurgi/bert_emotion_response_classifier_quantized
Text Classification • Updated • 14
Hariprasath28/orpheus-3b-4bit-AWQ
Text Generation • 3B • Updated • 99
mirekphd/whisper-large-v3-onnx-fp16
Automatic Speech Recognition • Updated • 10
mirekphd/whisper-large-v3-onnx-w8a16-dynamic
Automatic Speech Recognition • Updated • 9
mirekphd/whisper-large-v3-onnx-w4a16-dynamic
Automatic Speech Recognition • Updated • 7
steampunque/Qwen2.5-VL-32B-Instruct-MP-GGUF
33B • Updated • 58
theprint/Zeth-Gemma3-4B-GGUF
Text Generation • 5B • Updated • 145
HackNetAyush/smollm2-135M-instruct-gguf-q8
Text Generation • 0.1B • Updated • 487 • 4
ericrisco/medical-gemma-3n-4b-gguf
7B • Updated • 32
nvidia/DeepSeek-R1-0528-NVFP4-v2
Text Generation • 394B • Updated • 29.4k • 23
steampunque/GLM-Z1-9B-0414-MP-GGUF
9B • Updated • 78 • 2
nvidia/DeepSeek-R1-NVFP4-v2
Text Generation • 394B • Updated • 440 • 8
YongdongWang/llama-3.2-1b-lora-qlora-dart-llm-gguf
Text Generation • 1B • Updated • 42 • 3
sugiv/cardvaultplus-500m-gguf
Image-to-Text • 0.4B • Updated • 163 • 4
PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M
7B • Updated • 7
nufikq/tinyllama-php-finetuned-test1
Updated
SaidzodaEng/Ameena_Qwen3-8B_e3_Quantised_gguf
8B • Updated
Bastion-AI/SmolLM3-3B-GGUF
3B • Updated • 231 • 1
NVFP4/Qwen3-235B-A22B-Instruct-2507-FP4
Text Generation • 118B • Updated • 74 • 4
NVFP4/Qwen3-Coder-480B-A35B-Instruct-FP4
Text Generation • 241B • Updated • 49 • 3
nvidia/Qwen3-235B-A22B-Eagle3
Text Generation • 0.3B • Updated • 528 • 14
PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M
7B • Updated • 11
AINovice2005/Voxtral-Mini-3B-2507-smashed
Audio-Text-to-Text • Updated
AINovice2005/medgemma-4b-it-smashed
Image-Text-to-Text • 4B • Updated • 13
theprint/TiTan-Llama-3.2-1B-GGUF
Text Generation • 1B • Updated • 167
kanrishaurus/gemma2-9b-cpt-sahabatai-v1-instruct-gguf
Text Generation • 9B • Updated • 20
theprint/TiTan-Gemma3-4B-GGUF
Text Generation • 5B • Updated • 114
stevenalbert10/gemma3-27b-gguf
Text Generation • 27B • Updated • 38 • 1
dynomite567/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
8B • Updated • 11