Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,792

Base only

Active filters: bitsandbytes

sam2ai/llama3_8b_odia_v1

Text Generation • Updated Apr 24, 2024 • 6

RichardErkhov/meta-llama_-_LlamaGuard-7b-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

LoftQ/Meta-Llama-3-70B-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 3 • 1

OmarSamehSaid/LLM-CXR-v1

Text Generation • 3B • Updated Apr 21, 2024 • 7

yyx123/Yi-6B-ruozhiba3

Updated May 5, 2024 • 9

nuebaek/komt_mistral_mss_user_0_max_steps_80

Text Generation • 7B • Updated Apr 22, 2024 • 5

RichardErkhov/meta-llama_-_Llama-2-70b-chat-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 6

RichardErkhov/meta-llama_-_LlamaGuard-7b-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

Omartificial-Intelligence-Space/al-baka-4bit-llama3-8b

Text Generation • 8B • Updated Apr 21, 2024 • 8 • 1

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 4

guptasaurabh78/ph2-sau-samsum-ft-1

Text Generation • 3B • Updated Apr 21, 2024 • 6

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 6

Ti-ger/Qwen1.5-4B-CQIA

Text Generation • 4B • Updated Apr 23, 2024 • 10

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

yyx123/Yi-6B-ruozhiba4

Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-13b-Instruct-hf-4bits

Text Generation • 13B • Updated Apr 21, 2024 • 4

yyx123/Yi-6B-zhihu5

Updated Apr 24, 2024 • 13

AmanBankoti/outputs_merged1

Text Generation • 7B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-70b-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 5

palgraciel/Meta-Llama-3-8B-Instruct-leo-kor

Text Generation • 8B • Updated Apr 26, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 11

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 6

MatthieuO/Mistroll-v0.1

Updated Apr 21, 2024 • 1

chansung/coding_llamaduo_result3

Updated Apr 22, 2024 • 3

KvrParaskevi/Llama-2-7b-Hotel-Booking-Model-8Bit

Text Generation • 7B • Updated May 16, 2024 • 8