Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,281

Base only

Active filters: quantization

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated 17 days ago • 2.49k • 1

realrebelai/Wan_Dancer_GGUFs

17B • Updated 13 days ago • 17.4k • 14

Litwein/ThinkingCap-Qwen3.6-27B-oQ4e-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 5B • Updated 13 days ago • 801 • 2

Litwein/ThinkingCap-Qwen3.6-27B-oQ4e-DWQ-MTP-MLX

Text Generation • 4B • Updated 13 days ago • 366 • 1

kongbai-84/AnimaInt8Quantizer-Portable

Updated 13 days ago • 1

VladimirRH/bge-m3-quantized-int8

Feature Extraction • Updated 11 days ago • 2

ajh-code/Mage-Flow-NVFP4-AJH

Text-to-Image • 3B • Updated 6 days ago • 69 • 1

ajh-code/Mage-Flow-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 6 days ago • 28 • 1

ajh-code/Mage-Flow-NVFP4-Quality-AJH

Text-to-Image • 4B • Updated 6 days ago • 16 • 1

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated about 19 hours ago • 505 • 1

kingjones777/Leanstral-1.5-119B-A6B-Q4_0_ROCMFP4_STRIX_LEAN-GGUF

Text Generation • 119B • Updated 4 days ago • 202 • 1

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated 1 day ago • 553 • 1

LeadingPoint/R3-embedding-0.6b-GGUF

0.6B • Updated 3 days ago • 100 • 1

LeadingPoint/R3-rerank-0.6b-GGUF

0.6B • Updated 3 days ago • 94 • 1

nmicic/int-llm

Updated 1 day ago • 1

groxaxo/Nemotron-3-Embed-1B-oQ5-MLX

Feature Extraction • 0.2B • Updated 1 day ago • 66 • 1

groxaxo/Nemotron-3-Embed-1B-oQ2-MLX

Feature Extraction • 0.1B • Updated about 18 hours ago • 1

Zewsic/Qwen-Image-Edit-Rapid-AIO-v19-NVFP4

Image-to-Image • Updated May 21 • 4

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 9 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 6 • 5

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 19

leumastai/t5-large-quantized

Updated Mar 16, 2023 • 2 • 1

pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation • Updated Dec 29, 2025 • 8 • 3

limcheekin/flan-t5-small-ct2

Updated May 24, 2023 • 4

limcheekin/flan-t5-xl-ct2

Updated Jun 3, 2023 • 3 • 1

limcheekin/flan-t5-xxl-ct2

Updated May 30, 2023 • 3 • 1

limcheekin/fastchat-t5-3b-ct2

Text Generation • Updated Jun 28, 2023 • 6 • 2

limcheekin/flan-alpaca-gpt4-xl-ct2

Updated Jun 4, 2023

limcheekin/mpt-7b-storywriter-ct2

Updated Jun 27, 2023 • 2

limcheekin/falcon-7b-instruct-ct2

Updated Jun 19, 2023 • 1 • 1