ogiwrghs/Phi-3-medium-128k-instruct-GGUF
Text Generation • 14B • Updated • 6
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
2,306
Active filters: quantization
avtc/GLM-4.5-Air-GPTQMODEL-W4A16
Text Generation • 121B • Updated • 25
jgerster0/Apertus-8B-Instruct-2509-LOGEQ-FP8_dynamic
8B • Updated • 3
coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-nvfp4
Updated • 123 • 2
Tfloow/Llama-3.2-1B-Instruct-adpq-4bit-sim
1B • Updated • 3
Tfloow/Llama-3.2-3B-Instruct-adpq-4bit-sim
3B • Updated • 2
Tfloow/Llama-3.2-3B-adpq-4bit-sim
3B • Updated • 3
Veyllo/VQ-1_Instruct-q4_k_m
Text Generation • 8B • Updated • 18 • 1
SamMikaelson/OCR-int4-merged
1B • Updated • 4
Tfloow/Llama-3.1-8B-Instruct-adpq-4bit-sim
8B • Updated • 3
SamMikaelson/ocr_random_merged
1B • Updated • 5
uygarkurt/Llama-3.1-8B-Instruct-GGUF
Text Generation • 8B • Updated • 140
ProtoNeuron-3/Nucleus-V-1.5-7B
8B • Updated • 23 • 1
SamMikaelson/OLD_INT_8
3B • Updated • 5
gyung/lfm2-1.2b-koen-mt-v4-100k-GGUF
Translation • 1B • Updated • 6 • 1
ealexeev/Mistral-Small-24B-NVFP4
Text Generation • 14B • Updated • 8
ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16
Text Generation • 6B • Updated • 6
Levelfive/qwen2.5-coder-7b-instruct-q4km-only
Text Generation • 8B • Updated • 73
KRAFTYUX/phi3-prompt-engineer-gguf
4B • Updated • 21
Levelfive/qwen2.5-coder-7b-instruct-q4km-complete
Text Generation • 8B • Updated • 5
ig1/BioMistral-7B-FP8-Dynamic
Text Generation • 7B • Updated • 6
Casual-Autopsy/Maginum-Cydoms-24B-exl3
Text Generation • Updated • 2 • 1
ig1/medgemma-27b-it-FP8-Dynamic
Text Generation • 29B • Updated • 8.24k
ig1/medgemma-27b-text-it-FP8-Dynamic
Text Generation • 28B • Updated • 964
josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4
Text Generation • 23B • Updated • 26
Shifusen/L3.3-70B-Magnum-v4-SE-NVFP4
Text Generation • 41B • Updated • 13
avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16-V2
Text Generation • 271B • Updated • 80 • 1
Abhinav-Tyagi/synapse-slm
Text Generation • 3B • Updated • 11
ealexeev/The-Drummer-Magidonia-24B-v4.2.0-NVFP4
Text Generation • 14B • Updated • 12
Shifusen/Strawberrylemonade-L3-70B-v1.2-NVFP4
Text Generation • 41B • Updated • 45