Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,298

Base only

Active filters: quantization

plawanrath/qwen2.5-7b-instruct-q4-mlx-cba

Text Generation • 1B • Updated May 19 • 14

plawanrath/qwen2.5-7b-instruct-q3-mlx-cba

Text Generation • 1.0B • Updated May 19 • 26

plawanrath/mistral-7b-instruct-v0.3-bf16-mlx-cba

Text Generation • 7B • Updated May 19 • 14

plawanrath/mistral-7b-instruct-v0.3-q8-mlx-cba

Text Generation • 7B • Updated May 19 • 29

plawanrath/mistral-7b-instruct-v0.3-q6-mlx-cba

Text Generation • 7B • Updated May 19 • 22

plawanrath/mistral-7b-instruct-v0.3-q4-mlx-cba

Text Generation • 1B • Updated May 19 • 37

plawanrath/mistral-7b-instruct-v0.3-q3-mlx-cba

Text Generation • 0.9B • Updated May 19 • 61

plawanrath/phi-3.5-mini-instruct-bf16-mlx-cba

Text Generation • 4B • Updated May 19 • 23

plawanrath/phi-3.5-mini-instruct-q8-mlx-cba

Text Generation • 1B • Updated May 19 • 28

plawanrath/phi-3.5-mini-instruct-q6-mlx-cba

Text Generation • 0.8B • Updated May 19 • 23

plawanrath/phi-3.5-mini-instruct-q4-mlx-cba

Text Generation • 0.6B • Updated May 19 • 56

plawanrath/phi-3.5-mini-instruct-q3-mlx-cba

Text Generation • 0.5B • Updated May 19 • 88

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-INT4

Text Generation • 2B • Updated May 5 • 10

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

Text Generation • 2B • Updated May 5 • 51 • 1

gratex/Mistral-Small-3.2-24B-Instruct-2506-W4A16-AutoRound

Image-Text-to-Text • 4B • Updated May 9 • 315

JANGQ-AI/MiniMax-M2.7-JANGTQ_K

Text Generation • 20B • Updated May 8 • 331 • 15

OsaurusAI/MiniMax-M2.7-JANGTQ_K

Text Generation • 20B • Updated May 8 • 48

szymonrucinski/FTerViT

Image Classification • Updated May 21 • 1

amd/DeepSeek-V4-Flash-MXFP4

Text Generation • 158B • Updated 10 days ago • 72

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

Truthseeker87/solarhive-e4b-cactus

Image-Text-to-Text • Updated Jun 8

vrfai/Qwen3-ASR-0.6B-int4-QAD

Automatic Speech Recognition • 0.9B • Updated Jun 6 • 67 • 4

mack-williams/Light-Forcing

Updated Jun 9 • 1

embedl/all-MiniLM-L6-v2-quantized-trt

Sentence Similarity • Updated 7 days ago

salve-mundii/gemma4-E4B-opt

Image-Text-to-Text • 8B • Updated Jun 15 • 4 • 3

hipfire-models/qwen3.5-4b-dev

hipfire-models/qwen3.5-9b-dev

majentik/TinyLlama-1.1B-Chat-v1.0-QuadRotor-Full-4bit

Text Generation • 1B • Updated 14 days ago • 28

majentik/SmolLM2-1.7B-Instruct-QuadRotor-Full-4bit

Text Generation • 2B • Updated 14 days ago • 33

hipfire-models/qwen3.6-27b-dev

Updated Jun 15 • 1