Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,399

Base only

Active filters: quantized

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 85 • 1

MaziyarPanahi/Qwen2.5-7B-Gordion-v0.1-Prose-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 108

MaziyarPanahi/Llama-Krikri-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 223

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10, 2025 • 16 • 4

smokxy/saaasssas-optimized

0.1B • Updated Feb 11, 2025 • 10

smokxy/dasdasda-optimized

0.1B • Updated Feb 11, 2025 • 8

smokxy/dasdasdad-optimized

0.1B • Updated Feb 11, 2025 • 8

smokxy/dsadsc-optimized

0.1B • Updated Feb 11, 2025 • 11

smokxy/dascxas-optimized

0.1B • Updated Feb 12, 2025 • 4

Atotti/RakutenAI-2.0-mini-instruct-gguf

2B • Updated Feb 12, 2025 • 119 • 3

smokxy/dsadsvc-optimized

0.1B • Updated Feb 12, 2025 • 9

smokxy/dsadsvcc-optimized

77M • Updated Feb 12, 2025 • 13

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 163 • 1

MaziyarPanahi/QVikhr-2.5-1.5B-Instruct-r-GGUF

Text Generation • 2B • Updated Feb 12, 2025 • 136

MaziyarPanahi/S1_4o_mini-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 67

MaziyarPanahi/Intelligence-Agent-7B-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 181

MaziyarPanahi/german-r1-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 179 • 1

MaziyarPanahi/SAXON-0-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 214

MaziyarPanahi/Gemma-9B-Base-GGUF

Text Generation • 9B • Updated Feb 12, 2025 • 105

TheMelonGod/AceInstruct-7B-exl2

Text Generation • Updated Feb 16, 2025 • 24

Wade5/MyModel2

Text Generation • 2B • Updated Feb 14, 2025 • 59

mradermacher/turn-detector-i1-GGUF

0.1B • Updated Apr 21 • 823

MaziyarPanahi/Hiber-Multi-10B-Instruct-GGUF

Text Generation • 11B • Updated Feb 14, 2025 • 78

MaziyarPanahi/LlamaThink-8B-instruct-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 207

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • 9B • Updated Feb 14, 2025 • 89 • 1

MaziyarPanahi/Korean-QWEN-Coder2.5-14B-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 179

MaziyarPanahi/Viper-Coder-v1.1-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 67

MaziyarPanahi/DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 264 • 1

MaziyarPanahi/Magellanic-Opus-14B-Exp-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 98

MaziyarPanahi/Kyro-n1-3B-GGUF

Text Generation • 3B • Updated Feb 14, 2025 • 157