Inference Providers
Active filters: 8bit
adriabama06/GLM-4-9B-0414-exl3
Text Generation • Updated • 14
• 1
adamrb/mpt-30b-chat-w8a8-gptq
30B • Updated • 10
Irfanuruchi/Llama-3.2-1B-Computer-Engineering-LLM
VincentGOURBIN/voxtral-small-8bit
Automatic Speech Recognition • 25B • Updated • 38
Hariprasath28/orpheus-3b-multi-gptq-8bit
Text Generation • Updated • 4
jestevesv/qwen1.5-0.5b-chat
Text Generation • Updated • 2
manohar03/unsloth-whisper-large-v3-turbo-pruna-8bit
Automatic Speech Recognition • 0.8B • Updated • 2
FilledVaccum/Llama-3-Nanda-10B-Chat-Quantized-8-Bits
Text Generation • 10B • Updated • 10
Varadrajan/llama-3.1-8b-alpaca-finetuned_8bit_gguf
Text Generation • 8B • Updated • 52
SiddhJagani/gpt-oss-20b-no-think-mlx-Q8
Text Generation • 21B • Updated • 50
• 1
chaitnya26/VibeVoice-Large-Q8-fork
Text-to-Audio • 9B • Updated • 4
• 1
Hariprasath28/svara-tts-v1-gptq
Text Generation • 3B • Updated • 17
Hariprasath28/veena-tts-gptq
Text Generation • 3B • Updated • 28
kyr0/crisperwhisper-unsloth-mlx-8b
Automatic Speech Recognition • Updated • 18
• 1
matica0902/MLX-Video-OCR-DeepSeek-Apple-Silicon
introvoyz041/LFM2-8B-A1B-8bit-MLX-mlx-8Bit
Text Generation • 8B • Updated • 16
Wezenite/gemma-2b-trader-8bit
Text Generation • 3B • Updated • 4
kirubel1738/biogpt-bioqa-8bit-openvino
Question Answering • Updated • 30
speakleash/Bielik-11B-v3.0-Instruct-FP8-Dynamic
Text Generation • 11B • Updated • 1.81k
• 7
Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit
Text Generation • 2B • Updated • 10
AITRADER/Amsi-fin-o1-MLX-8bit
Image-Text-to-Text • 4B • Updated • 37
• 1
Jr12lm12/Meta-Llama-3.1-8B-climate-expert-GGUF
Text Generation • 8B • Updated • 21
LibraxisAI/Bielik-11B-v3.0-mlx-q8
Text Generation • 11B • Updated • 32
Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-8bit
Text Generation • 0.5B • Updated • 8
speakleash/Bielik-Minitron-7B-v3.0-Instruct-FP8-Dynamic
Text Generation • 7B • Updated • 285
• 2
SuperPauly/Gemmasutra_LiteRT-LM
Text Generation • Updated • 7
JongYeop/Qwen2.5-14B-Instruct-FP8-W8A8
Text Generation • 15B • Updated • 12
JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic
Image-to-Text • 5B • Updated • 57
safestack/Bielik-11B-v3.0-Instruct-FP8-Dynamic
Text Generation • 11B • Updated • 42
shieldstackllc/GLM-4.7-Flash-PRISM-mlx-8bit
Text Generation • 30B • Updated • 38