Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,789

Base only

Active filters: bitsandbytes

cstr/phi-3-orpo-v9_4

Text Generation • 4B • Updated 6 days ago • 14 • 1

dbaek111/Phi-3-mini-128k-instruct-Instruct-Elon_407_HPC_Q

Text Generation • 4B • Updated May 3, 2024

cemt/Alpaca-llama-3-4bit

Text Generation • 8B • Updated Apr 30, 2024 • 5

dbaek111/Mistral-7B-v0.2-Elon_407_HPC_Q

Text Generation • 7B • Updated May 1, 2024

willieseun/Enron-Mixral-8x7b-instruct

Text Generation • 48B • Updated Jul 24, 2025 • 9 • 1

saadliaquat19/Llama-3-Patient-Doctor

Feature Extraction • 8B • Updated Apr 30, 2024 • 2

saadliaquat19/Llama-3-Patient-Doctor-2

Feature Extraction • 8B • Updated Apr 30, 2024 • 3

TheRightHomeCareTeam/Sulis-Dr-Llama-8b-Medical-Chat

Text Generation • 8B • Updated May 1, 2024 • 24

sylviali/eracond_llama_2_grammar

Text Generation • 7B • Updated Apr 30, 2024 • 7 • 1

RichardErkhov/Qwen_-_Qwen1.5-0.5B-4bits

Text Generation • 0.5B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-0.5B-8bits

Text Generation • 0.5B • Updated Apr 30, 2024 • 5

RichardErkhov/Qwen_-_Qwen1.5-1.8B-4bits

Text Generation • 2B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-7B-4bits

Text Generation • 8B • Updated Apr 30, 2024 • 6

RichardErkhov/Qwen_-_Qwen1.5-4B-4bits

Text Generation • 4B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-1.8B-8bits

Text Generation • 2B • Updated Apr 30, 2024 • 4

LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 3 • 1

kyuhyun/final_4bit_DST_DPO_free

Text Generation • 11B • Updated Apr 30, 2024 • 5

RichardErkhov/Qwen_-_Qwen1.5-14B-4bits

Text Generation • 14B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-4B-8bits

Text Generation • 4B • Updated Jan 7 • 5

RichardErkhov/Qwen_-_Qwen1.5-7B-8bits

Text Generation • 8B • Updated Apr 30, 2024 • 3

Burhan02/Mistral-7B-Instruct-v0.2-ft

Updated May 2, 2024 • 2

RichardErkhov/Qwen_-_Qwen1.5-14B-8bits

Text Generation • 14B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-1.8B-Chat-4bits

Text Generation • 2B • Updated Apr 30, 2024 • 5

RichardErkhov/Qwen_-_Qwen1.5-1.8B-Chat-8bits

Text Generation • 2B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-4B-Chat-4bits

Text Generation • 4B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-4B-Chat-8bits

Text Generation • 4B • Updated Apr 30, 2024 • 4

RichardErkhov/Qwen_-_Qwen1.5-7B-Chat-4bits

Text Generation • 8B • Updated Apr 30, 2024 • 4

samiyousef/Command-R-4-bit

Text Generation • 35B • Updated Apr 30, 2024 • 8

RichardErkhov/Qwen_-_Qwen1.5-14B-Chat-4bits

Text Generation • 14B • Updated Apr 30, 2024 • 5

code-endurer/lora_model_1

Text Generation • 7B • Updated Apr 30, 2024 • 3