Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,794

Base only

Active filters: bitsandbytes

unsloth/llama-3-70b-bnb-4bit

Text Generation • 73B • Updated Nov 22, 2024 • 466 • 50

havvanilsu/gemma-7b-Finance_v1000_model

Text Generation • 9B • Updated Apr 18, 2024 • 4

corneille97/Llama-3-8B-4bits-turbo

Text Generation • 8B • Updated Apr 18, 2024 • 5

prince-canuma/Meta-Llama-3-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 5

Pot-l/mistral-7b-bnb-4bit-QA-merged

Text Generation • 7B • Updated Apr 18, 2024 • 4

prince-canuma/Meta-Llama-3-8B-bnb-4bit

Text Generation • 8B • Updated Apr 18, 2024 • 4 • 1

LoftQ/Meta-Llama-3-8B-4bit-64rank

Text Generation • 8B • Updated May 3, 2024 • 425 • 2

LoftQ/CodeLlama-7b-hf-4bit-64rank

Text Generation • 7B • Updated Apr 20, 2024 • 6

LoftQ/CodeLlama-13b-hf-4bit-64rank

Text Generation • 13B • Updated Apr 20, 2024 • 5

ZachX/UltraMerge-v2-7B

Text Generation • 7B • Updated Apr 19, 2024 • 4

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • 8B • Updated Apr 21, 2024 • 5 • 1

OnlyCheeini/alpaca-llama3-8b

Text Generation • 8B • Updated Apr 19, 2024 • 5

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • 8B • Updated Apr 25, 2024 • 20 • 20

stuser2023/Llama3-8b-finetuned

Text Generation • 8B • Updated Mar 2, 2025 • 4

bnv20/Llama-2-7b-ConsultAI-kor

Text Generation • 7B • Updated Apr 19, 2024 • 4

YYYYYYibo/zephyr-7b-dpo-qlora

Updated Apr 25, 2024 • 1

kshitijkutumbe/Address-Extraction-Finetuned-Tinyllama

Text Generation • Updated Apr 19, 2024 • 6

weege007/llama-3-8b-bnb-4bit-alpaca-merged-4bit

Text Generation • 8B • Updated Apr 22, 2024 • 6

Raul569/oufit_recommender_19_Apr_2024_v2

Text Generation • 4B • Updated Apr 19, 2024 • 5

PrahmodhRaj/Llama-3_Finance_QA_Finetuned

Updated Apr 19, 2024 • 4

mani-a-i/mistral-7b-v2-full-model

Text Generation • 7B • Updated Apr 19, 2024 • 3

viktorahmeti/Mistral-7B-European-Commission-Kosovo-2023-Report-FT

Text Generation • 7B • Updated Apr 19, 2024 • 2

mohammednuruddin/openhermes-advance-function-v1

7B • Updated Apr 19, 2024 • 1

Chat-Error/Llama-3-Kimiko-temp

Updated Apr 19, 2024 • 3

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • 73B • Updated Sep 3, 2024 • 253 • 41

martyyz/llama3-8b-oig-unsloth-merged_4bit

Text Generation • 8B • Updated Apr 19, 2024 • 4

sroecker/merlinite-7b-bnb-4bit

Text Generation • 7B • Updated Apr 19, 2024 • 4

BarraHome/llama-3-newborn-4bits

Text Generation • 8B • Updated Apr 19, 2024 • 5

rhaymison/Mistral-8x7b-Quantized-portuguese-luana

Text Generation • 47B • Updated Apr 23, 2024 • 6 • 1

Dogge/llama-3-70B-instruct-uncensored-lora

Text Generation • Updated Apr 20, 2024 • 5 • 3