Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,947

Base only

Active filters: bitsandbytes

RichardErkhov/distilbert_-_distilgpt2-8bits

Text Generation • 82M • Updated May 1, 2024 • 16

RichardErkhov/openai-community_-_gpt2-medium-4bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 21

RichardErkhov/openai-community_-_gpt2-medium-8bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 14

RichardErkhov/openai-community_-_gpt2-large-4bits

Text Generation • 0.8B • Updated May 1, 2024 • 15

RichardErkhov/openai-community_-_gpt2-large-8bits

Text Generation • 0.8B • Updated May 1, 2024 • 17

RichardErkhov/openai-community_-_gpt2-xl-4bits

Text Generation • 2B • Updated May 2, 2024 • 31

RichardErkhov/openai-community_-_gpt2-xl-8bits

Text Generation • 2B • Updated May 2, 2024 • 18

RichardErkhov/openai-community_-_gpt2-4bits

Text Generation • 0.1B • Updated May 1, 2024 • 17

RichardErkhov/openai-community_-_gpt2-8bits

Text Generation • 0.1B • Updated May 1, 2024 • 19

RichardErkhov/EleutherAI_-_gpt-neo-1.3B-4bits

Text Generation • 1B • Updated Apr 23, 2024 • 16

RichardErkhov/EleutherAI_-_gpt-neo-125m-4bits

Text Generation • 0.1B • Updated Apr 23, 2024 • 27

RichardErkhov/EleutherAI_-_gpt-neo-125m-8bits

Text Generation • 0.1B • Updated Apr 23, 2024 • 15

RichardErkhov/EleutherAI_-_gpt-neo-1.3B-8bits

Text Generation • 1B • Updated Apr 23, 2024 • 31

GGmorello/FLAMES

Text Generation • 7B • Updated Jun 11, 2024 • 15 • 1

RichardErkhov/EleutherAI_-_gpt-neo-2.7B-4bits

Text Generation • 3B • Updated Apr 23, 2024 • 21

RichardErkhov/GroNLP_-_gpt2-medium-italian-embeddings-4bits

Text Generation • 0.3B • Updated Apr 17, 2024 • 20

RichardErkhov/GroNLP_-_gpt2-medium-italian-embeddings-8bits

Text Generation • 0.3B • Updated Apr 17, 2024 • 21

RichardErkhov/EleutherAI_-_gpt-neo-2.7B-8bits

Text Generation • 3B • Updated Apr 23, 2024 • 20

RichardErkhov/GroNLP_-_gpt2-small-dutch-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 18

RichardErkhov/GroNLP_-_gpt2-small-dutch-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 21

lilyyellow/unsloth-mistral-7b-bnb-4bit-sft-merged-add-start-end-index

Text Generation • 7B • Updated Apr 17, 2024 • 21

RichardErkhov/GroNLP_-_gpt2-small-italian-embeddings-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 21

RichardErkhov/GroNLP_-_gpt2-small-italian-embeddings-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 23

RichardErkhov/GroNLP_-_gpt2-small-italian-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 21

RichardErkhov/GroNLP_-_gpt2-small-italian-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 24

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-4bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 18

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-8bits

Text Generation • 0.4B • Updated Apr 17, 2024 • 15

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-4bits

Text Generation • 1B • Updated Apr 17, 2024 • 14

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-8bits

Text Generation • 1B • Updated Apr 17, 2024 • 15

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-4bits

Text Generation • 3B • Updated Apr 17, 2024 • 15