Inference Providers
Active filters: 8bit
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 10k
• 87
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation
• 35B • Updated • 13.2k
• 55
mlx-community/Ornith-1.0-9B-OptiQ-4bit
Image-Text-to-Text
• 9B • Updated • 803
• 4
mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit
Text Generation
• 25B • Updated • 4.11k
• 17
mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit
Text Generation
• 7B • Updated • 4.47k
• 13
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation
• 27B • Updated • 12.5k
• 71
mlx-community/gemma-4-12B-it-OptiQ-4bit
Text Generation
• 12B • Updated • 9.44k
• 41
mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit
Text Generation
• 25B • Updated • 3.32k
• 5
mlx-community/Qwen3.5-2B-OptiQ-4bit
Text Generation
• 0.4B • Updated • 1.34k
• 12
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.9B • Updated • 4.46k
• 26
jwindle47/chandra-ocr-2-8bit-mlx
Image-Text-to-Text
• 2B • Updated • 559
• 2
mlx-community/gemma-4-31B-it-OptiQ-4bit
Text Generation
• 31B • Updated • 9.96k
• 11
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit
Image-Text-to-Text
• 8B • Updated • 2.59k
• 5
mlx-community/Agents-A1-OptiQ-4bit
Image-Text-to-Text
• 35B • Updated • 631
• 3
mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit
Image-Text-to-Text
• 12B • Updated • 2.11k
• 3
mradermacher/ChunMengDie-1.0-0.4b-GGUF
0.3B • Updated • 434
• 2
SwinliQ-AIs/Qwen3.5-2B-4bit
Text Generation
• 0.4B • Updated • 1
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 4
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 8
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 5
• 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 21
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 6
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 4
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 3
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 7
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 5
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 6
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 7
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 6
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 107
• 10