Inference Providers
Active filters: 4bit
JustJaro/SmolLM-135M_gptq_g32_4bit
Text Generation • 0.1B • Updated • 4
ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly
Text Generation • 24B • Updated • 37
btbtyler09/Qwen3-30B-A3B-gptq-4bit
Text Generation • 31B • Updated • 12
dsuram/mistral-medical-finetuned
Text Generation • Updated nxtcloud-org/kanana-safeguard-8b-bitsandbytes-4bit
Text Generation • 8B • Updated • 13
• 1
nxtcloud-org/kanana-safeguard-prompt-2.1b-bitsandbytes-4bit
2B • Updated • 3
• 1
nxtcloud-org/kanana-safeguard-siren-8b-bitsandbytes-4bit
8B • Updated • 5
• 1
Cre4T3Tiv3/unsloth-llama3-alpaca-lora
Text Generation • Updated crazymaker1122/Llama-3.3-8B-Instruct-awq-direct
Text Generation • 8B • Updated • 3
Susant-Achary/smollm3-indian-recipes
Text Generation • Updated • 11
• 1
PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418
Text Generation • 13B • Updated • 9
adamrb/mpt-30b-chat-w4a16-gptq
30B • Updated • 10
PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938
Text Generation • 7B • Updated • 2
PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928
Text Generation • 7B • Updated • 1
kivoai/tinyllama-1.1b-chat-gptq
Text Generation • Updated • 8
Hariprasath28/orpheus-3b-4bit-AWQ
Text Generation • 3B • Updated • 32
codemajesty/gemma2b-4bit-quantized
Text Generation • 3B • Updated • 4
Irfanuruchi/1B-building-engineering-llm
1B • Updated • 5
Irfanuruchi/Llama-3.2-3B-Computer-Engineering-LLM
3B • Updated • 6
jw-sohn/Llama-3.1-8B-Instruct-nf4
Text Generation • 8B • Updated • 9
btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit
Text Generation • 31B • Updated • 28
• 3
VincentGOURBIN/voxtral-small-4bit-mixed
Automatic Speech Recognition • 25B • Updated • 108
• 1
sp-embraceable/e2-llama-v3p3-70B-Merged-v1-LQ
Text Generation • Updated YijingOlivia/llama3-movie-rating-lora
Updated
Jacaranda-Health/ASR-STT-4bit
Automatic Speech Recognition • 0.8B • Updated • 9
• 1
PaddySeahorse/tinyllama-4bit
Text Generation • 1B • Updated • 21
Seonghaa/CalMate-20B-KO-LoRA
Text Generation • Updated Hooshaai/Qwen3-4b-gsm8k-Qlora-SFT
Text Generation • Updated • 17
• 1
Hooshaai/Qwen3-4b-gsm8k-Qlora-GRPO
Text Generation • Updated • 8
• 2
sweatSmile/Gemma-3-270m-Buddha-QA
Question Answering • Updated • 10
• 1