Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,791

Base only

Active filters: bitsandbytes

JFernandoGRE/mistral_7b_augmenteddemocracy_dups_all4_25

Text Generation • 7B • Updated Mar 14, 2024 • 5

CohereLabs/c4ai-command-r-v01-4bit

Text Generation • 35B • Updated Apr 16, 2025 • 341 • 179

andrewcanis/c4ai-command-r-v01-8bit

Text Generation • 35B • Updated Mar 14, 2024 • 8 • 1

smasaduzzaman/Tuned_gemma_for_customer_service_bot

Text Generation • 3B • Updated Mar 14, 2024 • 4

SilasK/llama-7b-medqa_version_8

7B • Updated Mar 15, 2024 • 2

andrewcanis/c4ai-command-r-v01-4bit

Text Generation • 35B • Updated Mar 14, 2024 • 5

Fenrir96/mistral7b-vocadapt-4bit

Text Generation • 7B • Updated Mar 14, 2024 • 5

DinaYatsuk/gpt3_test_ru

Text Generation • 0.8B • Updated Mar 15, 2024 • 4

Serega6678/M7Bv01_SFT_50pct_QLORA_2H100

Updated Mar 15, 2024 • 2

akameswa/mistral-7b-instruct-python-4bit-old

Text Generation • 7B • Updated Mar 14, 2024 • 5

OwOpeepeepoopoo/eacctroll

Text Generation • 3B • Updated Mar 14, 2024 • 5

akameswa/mistral-7b-instruct-java-4bit-old

Text Generation • 7B • Updated Mar 14, 2024 • 4

akameswa/mistral-7b-instruct-cpp-4bit-old

Text Generation • 7B • Updated Mar 14, 2024 • 4

akameswa/mistral-7b-instruct-javascript-4bit-oldv2

Text Generation • 7B • Updated Mar 14, 2024 • 4

nlpllm007/g20_12_3_uat

Text Generation • 7B • Updated Mar 14, 2024 • 5

KadirErturk/image_info

Image-Text-to-Text • 9B • Updated Mar 14, 2024 • 15 • 1

Shaleen123/bruh2

Text Generation • 3B • Updated Mar 14, 2024 • 8

uisikdag/Mistral-7B-v0.1-recepie-tr

Text Generation • 7B • Updated Mar 14, 2024 • 5

leba01/qwen1.8b-vanilla-8bit-quant

Text Generation • 2B • Updated Mar 15, 2024 • 4

leba01/Llama-2-7b-hf-8bit-quant

Text Generation • 7B • Updated Mar 15, 2024 • 5

nluai/Llama-2-7b-chat-hf-vn

Text Generation • 7B • Updated Mar 17, 2024 • 4

juewang/Mixtral-8x7B-Instruct-v0.1-lora-test

Updated Mar 15, 2024 • 3

samaysk/springllama

7B • Updated Mar 22, 2024

reecursion123/falcon-7b-sharded-f16-finetuned-therapy-chatbot

Text Generation • Updated Mar 15, 2024 • 5

CurtisJeon/OrionStarAI-Orion-14B-Chat-4bit

Text Generation • 15B • Updated Mar 15, 2024 • 5

leba01/gemma-2b-8bit-quant

Text Generation • 3B • Updated Mar 15, 2024 • 5

SilasK/llama-7b-medqa_version_9

7B • Updated Mar 17, 2024 • 2

Yonur/model_nf4

Text Generation • 1B • Updated Mar 15, 2024 • 6

iampanky0/New_Gemma

Text Generation • 3B • Updated Mar 18, 2024 • 5 • 1

bharathirajan89/gemma-7b-it-2GB-shards-4bit-v1

Text Generation • 9B • Updated Mar 15, 2024 • 4