Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,946

Base only

Active filters: bitsandbytes

chansung/coding_llamaduo_result3

Updated Apr 22, 2024 • 8

KvrParaskevi/Llama-2-7b-Hotel-Booking-Model-8Bit

Text Generation • 7B • Updated May 16, 2024 • 24

Rorical/0-roleplay

Text Generation • 15B • Updated Jun 11, 2024 • 23 • 5

failspy/InternVL-Chat-V1-5-8bit

Visual Question Answering • 26B • Updated Apr 22, 2024 • 8 • 2

failspy/InternVL-Chat-V1-5-4bit

Feature Extraction • 26B • Updated Apr 22, 2024 • 20 • 6

jeongmi/solar_insta_chai_80_final

Text Generation • Updated May 6, 2024 • 15

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-4bits

Text Generation • 8B • Updated May 2, 2024 • 12

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • 8B • Updated May 2, 2024 • 29 • 1

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated May 2, 2024 • 20

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated May 2, 2024 • 20

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-4bits

Text Generation • 8B • Updated Apr 22, 2024 • 14

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-8bits

Text Generation • 8B • Updated Apr 22, 2024 • 16

hellomyoh/ll3-8b-mtft-en-ko-en.v0.1

Text Generation • 8B • Updated Apr 22, 2024 • 14

manishiitg/open-aditi-chat-hi-1.28-llama3

Updated Apr 22, 2024 • 4

dattaraj/Gemma-2b-it-mental-health

Text Generation • 3B • Updated Apr 22, 2024 • 19 • 3

GCMcM2024/blip2-opt-2.7b-spanish-without-lora

Visual Question Answering • 4B • Updated Apr 22, 2024 • 7

srirambhavadish/Mixtral_arxt_v1

Text Generation • 7B • Updated Apr 22, 2024

Rhma/mistral_7b_fine-tuned-kaggle

Text Generation • 8B • Updated Apr 22, 2024 • 12

jeongmi/solar_musinsa_user111_100

Text Generation • 11B • Updated Apr 22, 2024 • 16

JeromeMore/Meta-Llama-3-8B-Instruct-bnb_4bit

Text Generation • 8B • Updated Apr 22, 2024 • 13

JeromeMore/Meta-Llama-3-8B-Instruct-bnb_8bit

Text Generation • 8B • Updated Apr 22, 2024 • 14

TachyHealthResearch/Llama3-Medical-Finetune_QA_MCQ

8B • Updated Apr 25, 2024 • 10 • 1

Rhma/llama2_7b-hf_finetuned-kaggle

Text Generation • 7B • Updated May 2, 2024 • 13

RichardErkhov/sophosympatheia_-_Midnight-Miqu-70B-v1.5-4bits

Text Generation • 70B • Updated Apr 22, 2024 • 14

IAVYang/modified_model

Text Generation • 8B • Updated Apr 22, 2024

gechim/vinallama-Q_4-ft-QAhealth

Text Generation • 3B • Updated Apr 22, 2024 • 13

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-base-4bits

Text Generation • 7B • Updated Apr 22, 2024 • 35

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-instruct-4bits

Text Generation • 7B • Updated Apr 22, 2024 • 35

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-base-8bits

Text Generation • 7B • Updated Apr 22, 2024 • 30

RichardErkhov/deepseek-ai_-_deepseek-coder-6.7b-instruct-8bits

Text Generation • 7B • Updated Apr 22, 2024 • 32