Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,946

Base only

Active filters: bitsandbytes

taozi555/llama3-8b-pippa

Updated Apr 21, 2024 • 7

jeongmi/solar_musinsa_user0

Text Generation • 11B • Updated Apr 21, 2024 • 14

sam2ai/llama3_8b_odia_v1

Text Generation • Updated Apr 24, 2024 • 14

RichardErkhov/meta-llama_-_LlamaGuard-7b-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 23

LoftQ/Meta-Llama-3-70B-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 16 • 1

OmarSamehSaid/LLM-CXR-v1

Text Generation • 3B • Updated Apr 21, 2024 • 14

yyx123/Yi-6B-ruozhiba3

Updated May 5, 2024 • 11

nuebaek/komt_mistral_mss_user_0_max_steps_80

Text Generation • 7B • Updated Apr 22, 2024 • 22

RichardErkhov/meta-llama_-_Llama-2-70b-chat-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 13

RichardErkhov/meta-llama_-_LlamaGuard-7b-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 25

Omartificial-Intelligence-Space/al-baka-4bit-llama3-8b

Text Generation • 8B • Updated Apr 21, 2024 • 27 • 1

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 14

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 14

guptasaurabh78/ph2-sau-samsum-ft-1

Text Generation • 3B • Updated Apr 21, 2024 • 15

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 19

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 21

Ti-ger/Qwen1.5-4B-CQIA

Text Generation • 4B • Updated Apr 23, 2024 • 16

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 21

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 16

yyx123/Yi-6B-ruozhiba4

Updated Apr 21, 2024 • 8

RichardErkhov/meta-llama_-_CodeLlama-13b-Instruct-hf-4bits

Text Generation • 13B • Updated Apr 21, 2024 • 19

yyx123/Yi-6B-zhihu5

Updated Apr 24, 2024 • 11

AmanBankoti/outputs_merged1

Text Generation • 7B • Updated Apr 21, 2024 • 14

RichardErkhov/meta-llama_-_CodeLlama-70b-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 13

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 12

palgraciel/Meta-Llama-3-8B-Instruct-leo-kor

Text Generation • 8B • Updated Apr 26, 2024 • 12

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 20

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 14

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 17

MatthieuO/Mistroll-v0.1

Updated Apr 21, 2024 • 6