Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,864

Base only

Active filters: llama.cpp

bullerwins/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 20B • Updated about 7 hours ago • 832 • 1

kingjones777/Step-3.7-Flash-Q4_0_ROCMFP4_STRIX_LEAN-GGUF

Text Generation • 197B • Updated 2 days ago • 18 • 1

prometheusAIR/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 2 days ago • 390 • 1

miweru/Inkling-Small-REAP-137B-A12B-de-GGUF

Text Generation • 135B • Updated 1 day ago • 6.5k • 1

williamliao/Qwen3.6-35B-A3B-DSPARK-GGUF

Text Generation • 0.5B • Updated 2 days ago • 459 • 1

hellohazime/Kimi-K3-REAP640-IQ1_S-GGUF

Text Generation • 2T • Updated about 11 hours ago • 623 • 1

el4/GRM-3.2-Sky-OPAL-GGUF

Text Generation • 35B • Updated about 1 hour ago • 2.4k • 1

YTan2000/Laguna-XS-2.1-TQ3_4S

Text Generation • 33B • Updated 1 day ago • 1.12k • 1

DavidLanz/embeddinggemma-GTAIDE-300m-2605-GGUF

Feature Extraction • 0.3B • Updated about 23 hours ago • 248 • 1

Laurentiupad/LumiAgent-9B-v2-GGUF

Text Generation • 9B • Updated about 17 hours ago • 1

esalahterus/juicio-gguf

Text Generation • 8B • Updated about 15 hours ago • 151 • 1

MRockatansky/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-MTP-GGUF

Text Generation • 78B • Updated about 4 hours ago • 1

dealignai/Bonsai-27b-1bit-CRACK-GGUF

Image-Text-to-Text • 27B • Updated 18 days ago • 16.2k • 16

dealignai/Bonsai-27b-Ternary-CRACK-GGUF

Image-Text-to-Text • 27B • Updated 18 days ago • 45.1k • 21

dealignai/Laguna-S-2.1-CRACK-GGUF

Text Generation • 118B • Updated 10 days ago • 1.87k • 17

zeeksa/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-DFlash-GGUF

27B • Updated 17 days ago • 4.61k • 3

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-7b

7B • Updated Oct 9, 2023 • 2.47k • 113

mys/ggml_llava-v1.5-13b

13B • Updated Oct 10, 2023 • 1.05k • 55

mys/ggml_bakllava-1

7B • Updated Oct 19, 2023 • 631 • 75

wasmedge/llama2

Text Generation • 13B • Updated Nov 11, 2023 • 82 • 8

alvarobartt/lince-zero-7b-GGUF

Text Generation • 7B • Updated Nov 1, 2023 • 54

vietgpt/dama-2-7b-chat-gguf

Text Generation • 7B • Updated Nov 17, 2023 • 14 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

7B • Updated Dec 4, 2023 • 178 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

7B • Updated Dec 24, 2023 • 12

jacobhoffmann/CodeLlama-13B-TestGen-Dart_v0.2-GGUF

Text Generation • 13B • Updated Dec 11, 2024 • 43

mostafaamiri/persian-llama-7b-GGUF-Q4

7B • Updated Jan 13, 2024 • 94 • 9

ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

Text Generation • 9B • Updated Jan 24, 2024 • 36

ehristoforu/LLMs

Text Generation • 7B • Updated Apr 16, 2024 • 14 • 4