Inference Providers
Active filters: 4bit
ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2
Text Generation • 357B • Updated • 55
• 1
sweatSmile/Gemma-2-2B-MedicalQA-Assistant
Text Generation • 3B • Updated • 17
• 1
ModelCloud/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation • 269B • Updated • 24
• 2
mradermacher/Gemma-2-2B-MedicalQA-Assistant-GGUF
3B • Updated • 381
• 2
toddie314/toddric_v2_merged
Text Generation • 8B • Updated • 9
sanchezalonsodavid17/DeepSeek-OCR-MBQ-Quantized-v1
Image-Text-to-Text • 3B • Updated • 23
• 6
ModelCloud/MiniMax-M2-GPTQMODEL-W4A16
Text Generation • 229B • Updated • 27
• 3
ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16
Text Generation • 33B • Updated • 7
• 1
ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16
Text Generation • 33B • Updated • 10
• 2
ModelCloud/Granite-4.0-H-1B-GPTQMODEL-W4A16
Text Generation • 1B • Updated • 22
• 1
ModelCloud/Granite-4.0-H-350M-GPTQMODEL-W4A16
Text Generation • 0.3B • Updated • 40
• 1
ModelCloud/Brumby-14B-Base-GPTQMODEL-W4A16
Text Generation • 15B • Updated • 12
• 1
ModelCloud/Brumby-14B-Base-GPTQMODEL-W4A16-v2
Text Generation • 15B • Updated • 4
• 1
CHF0101/medquad-lora-r4-best
Updated
CHF0101/medquad-lora-r4-best-v2
CHF0101/medquad-lora-r32-best-v2
sweatSmile/Phi3-Mini-FinSight-FinancialQA
Text Generation • 4B • Updated • 12
• 1
ikarius/Granite-3.2-8b-instruct-Abliterated-NF4
Text Generation • 8B • Updated • 12
• 1
ikarius/NeuralDaredevil-8B-abliterated-NF4
Text Generation • 8B • Updated • 14
• 1
ikarius/Qwen2.5-Coder-14B-Instruct-Abliterated-NF4
Text Generation • 15B • Updated • 37
• 1
4B • Updated • 11
lunovian/Qwen2.5-Math-7B-Instruct-4bit
2B • Updated • 9
Plurigrid/DR-Tulu-8B-MLX-4bit
8B • Updated • 16
ujjwal52/Llama-2-7b-FLASH-UK
Text Generation • 7B • Updated • 6
• 1
Plurigrid/Olmo-3-32B-Think-MLX-4bit
Text Generation • 32B • Updated • 12
beta3/gemma3_1b_title_generator
Sugandha-Chauhan/BioMistral-7B-SymptomDiagnosis
Text Classification • Updated • 9