Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,792

Base only

Active filters: bitsandbytes

RichardErkhov/EleutherAI_-_pythia-160m-seed2-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 3

RichardErkhov/EleutherAI_-_pythia-160m-seed3-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-14m-4bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-14m-8bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-160m-seed3-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-1b-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 6

RichardErkhov/EleutherAI_-_pythia-31m-4bits

Text Generation • 30.6M • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-31m-8bits

Text Generation • 30.5M • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_pythia-1b-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 3

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-4bits

Text Generation • 7B • Updated Apr 23, 2024 • 4

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-8bits

Text Generation • 7B • Updated Apr 23, 2024 • 4

guptasaurabh78/ph2-sau-samsum-ft-2

Text Generation • 3B • Updated Apr 23, 2024 • 6

hikikomoriHaven/llama3-8b-hikikomori-v0.3

Text Generation • Updated Apr 25, 2024 • 6 • 3

ale-bay/distral-7b-v1

Updated May 22, 2024 • 13

yeelou/design2code-hf-bit4

Text Generation • Updated Apr 25, 2024 • 5

screevoai/llama3-70b-instruct-4bit

Text Generation • 73B • Updated Apr 23, 2024 • 4 • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Jun 8, 2024 • 9 • 6

leliuga/Phi-3-mini-128k-instruct-bnb-4bit

Text Generation • 4B • Updated Apr 23, 2024 • 6 • 1

martimfasantos/tinyllama-1.1b-chat-dpo-qlora

Updated Apr 24, 2024 • 5

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • 7B • Updated Apr 24, 2024 • 8 • 4

comidan/llama-3-chat-multilingual-v1-8b

Text Generation • 7B • Updated Apr 23, 2024 • 6 • 1

andrewatef/ReSV014bit

Text Generation • 1B • Updated Apr 23, 2024 • 7

K00B404/llama3_8B_pythoncodes25k_120steps_lora_4bit

Text Generation • 8B • Updated Apr 24, 2024 • 4 • 1

chansung/coding_llamaduo_60k

Updated Apr 24, 2024 • 30

morioxd/happymakerai_v3_1

Text Generation • 13B • Updated Apr 24, 2024 • 5

chansung/coding_llamaduo_60k_v0.2

Updated Apr 24, 2024 • 3

santoshsto/mistral-7b-cpp-FINETUNED-4bit

Text Generation • 7B • Updated Apr 24, 2024 • 4

santoshsto/mistral-7b-python-FINETUNED-4bit

Text Generation • 7B • Updated Apr 24, 2024 • 3

santoshsto/mistral-7b-java-FINETUNED-4bit

Text Generation • 7B • Updated Apr 24, 2024 • 4

santoshsto/mistral-7b-javascript-FINETUNED-4bit

Text Generation • 7B • Updated Apr 24, 2024 • 4