Inference Providers
Active filters: 8bit
mlx-community/MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 2.77k
• 10
nitinpanj/Qwen3.8-27B-Splash-HQ
Text Generation
• Updated • 194
• 6
mlx-community/LensVLM-9B-OptiQ-4bit
Image-Text-to-Text
• 9B • Updated • 181
• 5
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 4B • Updated • 10.8k
• 35
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation
• 35B • Updated • 5.33k
• 76
mlx-community/gemma-4-12B-it-OptiQ-4bit
Text Generation
• 12B • Updated • 2.98k
• 53
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
• 71B • Updated • 2.51k
• 11
mlx-community/Qwen3.5-2B-MLX-8bit
2B • Updated • 1.91k
• 11
mlx-community/Qwen3.5-9B-MLX-8bit
9B • Updated • 1.28k
• 14
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 12.9k
• 100
TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-8bit
Image-Text-to-Text
• 9B • Updated • 741
• 5
TheCluster/Gemma-4-26B-A4B-Heretic-MLX-8bit
Image-Text-to-Text
• 26B • Updated • 69
• 1
deer-sec/CyberStag-Security-26B-A4B-V1-Q8_0-GGUF
Text Generation
• 25B • Updated • 146
• 2
ahmedihamdy/Ornith-1.5-35B-A3B-OptiQ-static-5.5bpw
Image-Text-to-Text
• 35B • Updated • 795
• 6
nitinpanj/Qwen3.8-27B-Splash-Q8
Text Generation
• Updated • 1
FrankMS/NanoJev-1.7B-8bit
Text Classification
• Updated • 23
• 1
mlx-community/Xing4.0-29B-A4B-OptiQ-4bit
Text Generation
• 30B • Updated • 105
• 1
mlx-community/Hemmingway-1-OptiQ-4bit
Text Generation
• 27B • Updated • 242
• 1
Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF
Image-Text-to-Text
• 25B • Updated • 40.3k
• 83
0xSojalSec/UNSEEN_Gemma_4_26B_NSFW-GGUF
Image-Text-to-Text
• 25B • Updated • 641
• 1
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 35
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 27
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 36
• 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 43
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 32
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 26
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 23
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 28
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 26
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 29