Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,314

Base only

Active filters: quantization

pearsonkyle/Sharp-onnx

Image-to-3D • Updated Jan 17 • 5

er6y/Z-Image-Turbo-MNN-int4

Text-to-Image • Updated Jun 17 • 20 • 1

mrbrownn43/YOLOv11_customized-for-RaspberryPi4

Object Detection • Updated Jan 9

goniz/MiniMax-M2.1-REAP-30-GGUF

162B • Updated Jan 14 • 140 • 2

Octen/Octen-Embedding-8B-INT8

Sentence Similarity • 8B • Updated Feb 9 • 1.68k • 7

ryzerrr/DeepSeek-R1-V6rge-Optimized

Text Generation • Updated Jan 10

RyanLucas3/ptq-meta-llama_Meta-Llama-3-8B-W4A4-lf10-seed1

Text Generation • 8B • Updated Jan 11 • 15

RyanLucas3/ptq-meta-llama_Meta-Llama-3-8B-W6A6-lf5-seed1

Text Generation • 8B • Updated Jan 11 • 14

Pandeymp29/Amazon-Fashion-Semantic-Search

Sentence Similarity • Updated Jan 25

JEmilianomezas/mistral-7b-spinbit-4bit

Text Generation • Updated Jan 13

sprited/sprite-dx-anti-corruption-v1

Image-to-Image • 13.3M • Updated Jan 20 • 18 • 1

goniz/MiniMax-M2.1-REAP-40-GGUF

139B • Updated Jan 14 • 71

Amlogic-NN/Qwen2.5-1.5B-Instruct_quant_i8_adla

SamMikaelson/deepseek-ocr-int8-quantized

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf1-seed1-final

Text Generation • 1B • Updated Jan 15 • 11

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf10-seed1-final

Text Generation • 1B • Updated Jan 15 • 14

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf2-seed1-final

Text Generation • 1B • Updated Jan 15 • 11

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf25-seed1-final

Text Generation • 1B • Updated Jan 15 • 16

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf5-seed1-final

Text Generation • 1B • Updated Jan 15 • 14

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf50-seed1-final

Text Generation • 1B • Updated Jan 15 • 18

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf0.5-seed1-final

Text Generation • 1B • Updated Jan 15 • 17

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf1-seed1-final

Text Generation • 1B • Updated Jan 15 • 15

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf10-seed1-final

Text Generation • 1B • Updated Jan 15 • 16

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf2-seed1-final

Text Generation • 1B • Updated Jan 15 • 16

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf25-seed1-final

Text Generation • 1B • Updated Jan 15 • 16

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf5-seed1-final

Text Generation • 1B • Updated Jan 15 • 12

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf50-seed1-final

Text Generation • 1B • Updated Jan 15 • 17

deepsky-ia/TinyLlama-1.1B-Chat-v1.0-GGUF-MacQuantized

Text Generation • 1B • Updated Jul 1 • 10 • 1

Luigi/Falcon-H1-Tiny-Multilingual-100M-Instruct-GGUF

0.1B • Updated Jan 16 • 152

Amlogic-NN/Qwen2.5-0.5B-Instruct_quant_i8