Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,939

Base only

Active filters: bitsandbytes

RichardErkhov/EleutherAI_-_pythia-410m-deduped-4bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 16

RichardErkhov/EleutherAI_-_pythia-410m-deduped-8bits

Text Generation • 0.4B • Updated Apr 23, 2024 • 26

RichardErkhov/EleutherAI_-_pythia-2.8b-8bits

Text Generation • 3B • Updated Apr 23, 2024 • 20

RichardErkhov/EleutherAI_-_pythia-1b-deduped-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 17

RichardErkhov/EleutherAI_-_pythia-160m-seed1-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 22

RichardErkhov/EleutherAI_-_pythia-160m-seed1-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 24

RichardErkhov/EleutherAI_-_pythia-1b-deduped-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 16

RichardErkhov/EleutherAI_-_pythia-160m-seed2-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 20

RichardErkhov/EleutherAI_-_pythia-160m-seed2-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 17

RichardErkhov/EleutherAI_-_pythia-160m-seed3-4bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 22

RichardErkhov/EleutherAI_-_pythia-14m-4bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 12

RichardErkhov/EleutherAI_-_pythia-14m-8bits

Text Generation • 14.1M • Updated Apr 23, 2024 • 15

RichardErkhov/EleutherAI_-_pythia-160m-seed3-8bits

Text Generation • 0.2B • Updated Apr 23, 2024 • 16

RichardErkhov/EleutherAI_-_pythia-1b-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 27

RichardErkhov/EleutherAI_-_pythia-31m-4bits

Text Generation • 30.6M • Updated Apr 23, 2024 • 14

RichardErkhov/EleutherAI_-_pythia-31m-8bits

Text Generation • 30.5M • Updated Apr 23, 2024 • 22

RichardErkhov/EleutherAI_-_pythia-1b-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 20

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-4bits

Text Generation • 7B • Updated Apr 23, 2024 • 16

RichardErkhov/EleutherAI_-_Mistral-7B-v0.1-population-first-ft-8bits

Text Generation • 7B • Updated Apr 23, 2024 • 16

guptasaurabh78/ph2-sau-samsum-ft-2

Text Generation • 3B • Updated Apr 23, 2024 • 15

hikikomoriHaven/llama3-8b-hikikomori-v0.3

Text Generation • Updated Apr 25, 2024 • 11 • 3

ale-bay/distral-7b-v1

Updated May 22, 2024 • 7

yeelou/design2code-hf-bit4

Text Generation • Updated Apr 25, 2024 • 11

screevoai/llama3-70b-instruct-4bit

Text Generation • 73B • Updated Apr 23, 2024 • 20 • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Jun 8, 2024 • 29 • 6

leliuga/Phi-3-mini-128k-instruct-bnb-4bit

Text Generation • 4B • Updated Apr 23, 2024 • 19 • 1

martimfasantos/tinyllama-1.1b-chat-dpo-qlora

Updated Apr 24, 2024 • 11

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • 7B • Updated Apr 24, 2024 • 21 • 4

comidan/llama-3-chat-multilingual-v1-8b

Text Generation • 7B • Updated Apr 23, 2024 • 20 • 1

andrewatef/ReSV014bit

Text Generation • 1B • Updated Apr 23, 2024 • 14