Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,923

Base only

Active filters: bitsandbytes

dbands/Phi-3-mini-4k-code-instructions-122k-alpaca-style-4bit

Text Generation • 4B • Updated May 3, 2024 • 12

RichardErkhov/m-a-p_-_OpenCodeInterpreter-DS-6.7B-4bits

Text Generation • 7B • Updated May 3, 2024 • 13

RichardErkhov/stabilityai_-_stablelm-2-zephyr-1_6b-4bits

Text Generation • 2B • Updated May 3, 2024 • 29

RichardErkhov/m-a-p_-_OpenCodeInterpreter-DS-6.7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 13

RichardErkhov/stabilityai_-_stablelm-2-zephyr-1_6b-8bits

Text Generation • 2B • Updated May 3, 2024 • 26

RichardErkhov/stabilityai_-_stablelm-2-1_6b-4bits

Text Generation • 2B • Updated May 3, 2024 • 22

RichardErkhov/stabilityai_-_stablelm-2-1_6b-8bits

Text Generation • 2B • Updated May 3, 2024 • 21

RichardErkhov/deepseek-ai_-_deepseek-coder-7b-instruct-v1.5-4bits

Text Generation • 7B • Updated May 3, 2024 • 32

RichardErkhov/deepseek-ai_-_deepseek-coder-7b-instruct-v1.5-8bits

Text Generation • 7B • Updated May 3, 2024 • 30

RichardErkhov/bigcode_-_starcoder2-15b-4bits

Text Generation • 16B • Updated May 3, 2024 • 45

chenbingAi/mistral-7b-bnb-4bit-1.0v

Text Generation • 7B • Updated May 3, 2024 • 12

JamesKim/mistral-7b-qlora-alpaca-sample-0.5k

Text Generation • 7B • Updated May 3, 2024 • 14

RichardErkhov/beomi_-_llama-2-ko-7b-4bits

Text Generation • 7B • Updated May 3, 2024 • 11

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-SFT-4bits

Text Generation • 7B • Updated May 3, 2024 • 12

RichardErkhov/beomi_-_llama-2-ko-7b-8bits

Text Generation • 7B • Updated May 3, 2024 • 15

jeongmi/SOLAR_TG

Text Generation • 11B • Updated May 3, 2024 • 11

shkna1368/kurdish_poetry_v3_model

Text Generation • Updated May 3, 2024 • 12

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-SFT-8bits

Text Generation • 7B • Updated May 3, 2024 • 13

RichardErkhov/GritLM_-_GritLM-7B-4bits

Text Generation • 7B • Updated May 3, 2024 • 16

RichardErkhov/GritLM_-_GritLM-7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 16

LoftQ/Phi-3-mini-128k-instruct-4bit-64rank

Text Generation • 4B • Updated May 3, 2024 • 29

LoftQ/Phi-3-mini-4k-instruct-4bit-64rank

Text Generation • 4B • Updated May 3, 2024 • 16

hi000000/llama2-koen_insta_TG

Text Generation • Updated May 5, 2024 • 9

RichardErkhov/Yotto3108_-_koSoLAR_2way_3000_10epoch_revised-4bits

Text Generation • 11B • Updated May 3, 2024 • 13

RichardErkhov/defog_-_sqlcoder-7b-2-4bits

Text Generation • 7B • Updated May 3, 2024 • 18 • 1

RichardErkhov/defog_-_sqlcoder-7b-2-8bits

Text Generation • 7B • Updated May 3, 2024 • 19

RichardErkhov/bigscience_-_bloomz-1b1-4bits

Text Generation • 1B • Updated May 3, 2024 • 20

RichardErkhov/bigscience_-_bloomz-1b1-8bits

Text Generation • 1B • Updated May 3, 2024 • 26

RichardErkhov/01-ai_-_Yi-34B-Chat-4bits

Text Generation • 35B • Updated May 3, 2024 • 24

RichardErkhov/OPI-PG_-_Qra-7b-4bits

Text Generation • 7B • Updated May 3, 2024 • 13