Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

186

Base only

Active filters: affine

ukisai/Swift-1.5-4bit-MLX

Text Generation • 28B • Updated 6 days ago • 1.53k • 8

ukisai/Swift-1.5-3bit-MLX-TextOnly

Text Generation • 27B • Updated 8 days ago • 691 • 4

ukisai/Swift-1.5-5bit-MLX

Text Generation • 28B • Updated 6 days ago • 1.76k • 3

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated about 1 month ago • 4.99k • 18

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-6bit-mlx

Text Generation • Updated Sep 15, 2025 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-8bit-mlx

Text Generation • Updated Sep 15, 2025

carlorrr/affine-0004-improved

Text Generation • 4B • Updated Oct 30, 2025 • 11

lyraresearchlabs/Affine-S3-GAME

Reinforcement Learning • 4B • Updated Dec 29, 2025 • 7

james-unicorn/affine-train-1

Text Generation • 4B • Updated Jan 26 • 13

james-unicorn/affine-2-5C5iKrLBTwNTuQdC1VB54tbjHVidxyjkh49AcYJ3zgqtkqgH

Text Generation • 4B • Updated Jan 27 • 11

rautaditya/Qwen3-4B-Instruct-MLX-4bit

Text Generation • 4B • Updated Mar 28 • 19

Deviad/DeepSeek-V4-Flash-MLX-Q4Q8

Text Generation • 149B • Updated Apr 29 • 216 • 1

lemuralabs/DeepSeek-V4-Flash-5bit-mlx

Text Generation • 284B • Updated Aug 5 • 132

lemuralabs/DeepSeek-V4-Flash-6bit-mlx

Text Generation • 284B • Updated Aug 5 • 164

ekryski/SmolLM2-360M-Instruct-4bit

0.4B • Updated May 27 • 9

ekryski/Soprano-1.1-80M-4bit

0.1B • Updated May 27 • 22

ekryski/Nemotron-H-4B-Base-8K-4bit

4B • Updated May 27 • 19

ekryski/FastVLM-0.5B-4bit

0.6B • Updated May 27 • 56

ekryski/Qwen3.5-0.8B-2bit

0.9B • Updated May 26 • 31

majentik/MERaLiON-3-3B-ASR-MLX-8bit

Automatic Speech Recognition • 3B • Updated Aug 22 • 29

ekryski/SmolLM-360M-Instruct-4bit

0.4B • Updated May 27 • 12

ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

9B • Updated May 27 • 75 • 1

ekryski/OLMo-2-0425-1B-Instruct-4bit

1B • Updated May 27 • 25

ekryski/starcoder2-3b-4bit

3B • Updated May 27 • 48

ekryski/granite-3.0-2b-instruct-4bit

3B • Updated May 27 • 14 • 1

ekryski/internlm2-chat-1_8b-4bit

2B • Updated May 27 • 32

ekryski/Nemotron-Nano-12B-v2-VL-4bit

13B • Updated May 28 • 39

ekryski/fish-audio-s2-pro-4bit

5B • Updated May 27 • 39

ekryski/diar_streaming_sortformer_4spk-v2.1-4bit

0.1B • Updated May 27 • 13

lemuralabs/Step-3.7-Flash-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 30B • Updated Aug 5 • 88 • 3