Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

881

Base only

Active filters: ggml

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 8 days ago • 5.84k • 141

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 82.3k • 293

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 275k • 538

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 46.6k • 45

remixerdec/Inflect-Nano-v2-GGUF

Text-to-Speech • 3.96M • Updated 4 days ago • 373 • 5

remixerdec/Inflect-Micro-v2-GGUF

Text-to-Speech • 9.34M • Updated 6 days ago • 318 • 4

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 16.7k • 82

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated 5 days ago • 23.6k • 8

LocalAI-io/TRELLIS.2-4B-GGUF

Image-to-3D • 0.5B • Updated 16 days ago • 1.08k • 3

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 154k • 189

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 44.9k • 84

cstr/canary-ctc-aligner-GGUF

Automatic Speech Recognition • 0.6B • Updated 21 days ago • 2.92k • 3

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.4k • 12

afrideva/phi-2-uncensored-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 504 • 13

ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1-GGUF

8B • Updated Dec 3, 2024 • 2.79k • 26

sujithatz/ggml-whisper-medium-ml

Updated Oct 3, 2025 • 2

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 13.7k • 62

unsloth/Qwen-Image-Edit-GGUF

Image-to-Image • 20B • Updated Dec 22, 2025 • 3.12k • 29

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 50.2k • 239

unsloth/LTX-2-GGUF

Image-to-Video • 19B • Updated Jan 22 • 4.43k • 134

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 9.99k • 186

Pomni/kotoba-whisper-v2.2-ggml-allquants

Automatic Speech Recognition • Updated Feb 9 • 1

ABBNDZ/ATTS1HG1

Text-to-Speech • 0.4B • Updated Mar 17 • 170 • 1

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 8.22k • 228

cstr/qwen3-tts-0.6b-base-GGUF

Text-to-Speech • 0.9B • Updated Apr 30 • 2.41k • 2

cstr/qwen3-tts-1.7b-voicedesign-GGUF

Text-to-Speech • 2B • Updated May 1 • 2.75k • 3

cstr/qwen3-tts-0.6b-customvoice-GGUF

Text-to-Speech • 0.9B • Updated May 1 • 1.58k • 3

cstr/m2m100-418m-GGUF

Translation • 0.5B • Updated 30 days ago • 839 • 2

cstr/pocket-tts-GGUF

Text-to-Speech • 0.1B • Updated 21 days ago • 1.09k • 2

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 7.48k • 12