Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,600

Base only

Active filters: bfloat16

Khetterman/Multilingual-SaigaSuzume-8B

Text Generation • 8B • Updated Nov 23, 2024 • 7 • 2

QuantFactory/L3-Aspire-Heart-Matrix-8B-GGUF

Text Generation • 8B • Updated Nov 29, 2024 • 104 • 2

DavidAU/L3.1-RP-Hero-InBetween-8B-GGUF

Text Generation • 8B • Updated May 28, 2025 • 404 • 8

DavidAU/L3.1-Instruct-Guru-8B-GGUF

Text Generation • 8B • Updated May 28, 2025 • 164 • 4

QuantFactory/Qwen2.5-7B-HomerAnvita-NerdMix-GGUF

Text Generation • 8B • Updated Dec 3, 2024 • 60 • 7

DavidAU/Llama-3.2-4X3B-MOE-Ultra-Instruct-10B-GGUF

Text Generation • 10B • Updated Jul 28, 2025 • 407 • 12

DavidAU/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B

Text Generation • 47B • Updated Jun 30, 2025 • 12 • 4

mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF

47B • Updated Jun 30, 2025 • 114

mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-i1-GGUF

47B • Updated Jun 30, 2025 • 170 • 3

DavidAU/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF

Text Generation • 25B • Updated May 28, 2025 • 305 • 6

DavidAU/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF

Text Generation • 47B • Updated Jun 11 • 374 • 18

DavidAU/L3-MOE-2X16.5B-DARKEST-Planet-Song-of-Fire-29B-GGUF

Text Generation • 29B • Updated Jul 28, 2025 • 14

itlwas/Kosmos-8B-v1-Q4_K_M-GGUF

8B • Updated Dec 18, 2024 • 7 • 1

itlwas/DarkAtom-12B-v3-Q4_K_M-GGUF

12B • Updated Dec 18, 2024 • 3 • 1

itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF

4B • Updated Dec 18, 2024 • 6 • 1

itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF

4B • Updated Dec 18, 2024 • 7 • 1

itlwas/CursedMatrix-8B-v9-Q4_K_M-GGUF

8B • Updated Dec 18, 2024 • 4 • 1

itlwas/AbominationScience-12B-v4-Q4_K_M-GGUF

12B • Updated Dec 18, 2024 • 2 • 1

QuantFactory/Multilingual-SaigaSuzume-8B-GGUF

8B • Updated Dec 21, 2024 • 54 • 2

DavidAU/L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32-GGUF

Text Generation • 25B • Updated Jul 28, 2025 • 653 • 42

matrixportalx/Kosmos-8B-v1-Q4_K_S-GGUF

8B • Updated Jan 3, 2025 • 20 • 2

matrixportalx/Multilingual-SaigaSuzume-8B-Q4_K_S-GGUF

8B • Updated Jan 3, 2025 • 22

matrixportalx/Kosmos-8B-v1-Q4_K_M-GGUF

8B • Updated Jan 9, 2025 • 15 • 2

matrixportalx/Kosmos-8B-v1-GGUF

8B • Updated Jan 13, 2025 • 11 • 1

matrixportalx/Llama-3.2-Kapusta-3B-v8-GGUF

4B • Updated Jan 14, 2025 • 8

matrixportalx/CursedMatrix-8B-v9-GGUF

8B • Updated Jan 14, 2025 • 16 • 1

matrixportalx/L3-Aspire-Heart-Matrix-8B-GGUF

Text Generation • 8B • Updated Jan 22, 2025 • 24

matrixportalx/Qwen2.5-7B-HomerCreative-Mix-GGUF

8B • Updated Jan 22, 2025 • 33

matrixportalx/LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

Text Generation • 8B • Updated Jan 22, 2025 • 27 • 2

DavidAU/DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-gguf

Text Generation • 17B • Updated Jul 28, 2025 • 345 • 24