Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

74

Base only

Active filters: sub-4-bit

liodon-ai/VulnLLM-R-7B-imatrix-GGUF

Text Generation • 8B • Updated 8 days ago • 185 • 1

liodon-ai/gemma-4-12B-it-imatrix-GGUF

Text Generation • 12B • Updated 18 days ago • 2.07k • 1

toxzak/gemma4-e2b-exp-quant

Text Generation • Updated Jun 29

liodon-ai/Ornith-1.0-35B-GGUF-imatrix-GGUF

Text Generation • 35B • Updated 18 days ago • 13.4k • 3

liodon-ai/VibeThinker-3B-imatrix-GGUF

Text Generation • 3B • Updated 18 days ago • 854

liodon-ai/Qwen3-0.6B-imatrix-GGUF

Text Generation • 0.8B • Updated 18 days ago • 921

liodon-ai/LFM2.5-8B-A1B-imatrix-GGUF

Text Generation • 8B • Updated 18 days ago • 1.48k • 2

liodon-ai/fable-traces-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 1.11k • 1

liodon-ai/MaralGPT-Mythos-9B-2606-GGUF-imatrix-GGUF

Text Generation • 9B • Updated 18 days ago • 1.44k

liodon-ai/Grug-12B-imatrix-GGUF

Text Generation • 12B • Updated 18 days ago • 1.84k

liodon-ai/Qwen2.5-0.5B-Instruct-imatrix-GGUF

Text Generation • 0.5B • Updated 18 days ago • 813

liodon-ai/phi-2-imatrix-GGUF

Text Generation • 3B • Updated 18 days ago • 433

liodon-ai/Qwen2.5-Coder-7B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated 18 days ago • 883

liodon-ai/Qwen3-4B-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 757

liodon-ai/Mistral-7B-Instruct-v0.2-imatrix-GGUF

Text Generation • 7B • Updated 18 days ago • 296

liodon-ai/Phi-3.5-mini-instruct-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 317

liodon-ai/DeepSeek-R1-Distill-Qwen-1.5B-imatrix-GGUF

Text Generation • 2B • Updated 18 days ago • 819

liodon-ai/Qwen2-7B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated 18 days ago • 745

liodon-ai/Phi-3-mini-4k-instruct-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 274

liodon-ai/Phi-4-mini-instruct-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 973

liodon-ai/Qwen3-4B-Thinking-2507-imatrix-GGUF

Text Generation • 4B • Updated 18 days ago • 831

liodon-ai/Qwen3-1.7B-imatrix-GGUF

Text Generation • 2B • Updated 18 days ago • 792

liodon-ai/Qwen2.5-0.5B-imatrix-GGUF

Text Generation • 0.5B • Updated 18 days ago • 812

liodon-ai/phi-4-imatrix-GGUF

Text Generation • 15B • Updated 18 days ago • 593

liodon-ai/bloom-560m-imatrix-GGUF

Text Generation • 0.6B • Updated 18 days ago • 1.42k

liodon-ai/Qwen3-14B-imatrix-GGUF

Text Generation • 15B • Updated 18 days ago • 823

liodon-ai/Qwen2.5-7B-imatrix-GGUF

Text Generation • 8B • Updated 18 days ago • 760 • 1

liodon-ai/Qwen2.5-14B-Instruct-imatrix-GGUF

Text Generation • 15B • Updated 18 days ago • 4.67k

liodon-ai/granite-4.1-8b-imatrix-GGUF

Text Generation • 9B • Updated 18 days ago • 612

liodon-ai/Qwen2-0.5B-Instruct-imatrix-GGUF

Text Generation • 0.5B • Updated 18 days ago • 810