Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,791

Base only

Active filters: bitsandbytes

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 4

1093212290a/idefics-9b-doodles

Image-Text-to-Text • 9B • Updated Apr 28, 2024 • 8

RichardErkhov/NousResearch_-_Meta-Llama-3-70B-4bits

Text Generation • 72B • Updated Apr 28, 2024 • 6

sid-th26/gemma-mcq-question-all-data

Text Generation • 9B • Updated Apr 28, 2024 • 7

basakerdogan/cyber-jarvis-llama3-4bit

Text Generation • 7B • Updated Apr 28, 2024 • 3

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • 8B • Updated Apr 29, 2024 • 62 • 30

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • 4B • Updated Apr 28, 2024 • 6 • 1

Alaa18/Assistant_chatbot_Mistral

Text Generation • 7B • Updated May 8, 2024 • 7 • 1

RichardErkhov/facebook_-_galactica-125m-4bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 8

RichardErkhov/facebook_-_galactica-125m-8bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 3

RichardErkhov/facebook_-_xglm-4.5B-4bits

Text Generation • 5B • Updated Apr 30, 2024 • 5

RichardErkhov/facebook_-_xglm-4.5B-8bits

Text Generation • 5B • Updated Apr 30, 2024 • 3

neotran/sdprompt_tiny_4bit

Text Generation • 1B • Updated Apr 28, 2024 • 8

dwb2023/mistral-7b-instruct-quantized

Text Generation • 7B • Updated Apr 29, 2024 • 5

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • 8B • Updated Apr 29, 2024 • 4 • 2

moetezsa/test

Text Generation • 8B • Updated Apr 29, 2024 • 6

Ramikan-BR/tinyllama_PY-CODER-bnb-4bit-lora_4k-v2_q4_k_m

Text Generation • Updated May 1, 2024 • 4

chansung/llamaduo_synth_ds_v0.1

Updated Apr 30, 2024 • 9 • 1

Aharneish/Llama-Chat-final_merged

Text Generation • 7B • Updated Apr 29, 2024 • 5

RichardErkhov/NousResearch_-_Hermes-2-Pro-Mistral-7B-4bits

Text Generation • 7B • Updated Apr 29, 2024 • 4

nayan8625/llama3-8b-ymhafinetuned

Text Generation • 8B • Updated Apr 29, 2024 • 5

RyotaKadoya1993/PEFT-MoE2

Text Generation • 6B • Updated Apr 29, 2024 • 7

rainjay/Meta-Llama-3-8B-Instruct-4bit

Text Generation • 8B • Updated May 8, 2024 • 3

eunyounglee/EEVE-LLM2Vec-MNTP-1-quant

Feature Extraction • 11B • Updated Apr 30, 2024 • 3

kloodia/lora-8b-code

Updated Apr 29, 2024 • 3

Mahesh2841/Llama_agrichat_3_merged

Question Answering • 8B • Updated Apr 30, 2024 • 2 • 1

Rebecca19990101/Llama3-Petro-Instruct-v1

Text Generation • 8B • Updated Apr 30, 2024 • 12

kishorea/Llama3_medqa

Text Generation • 8B • Updated Apr 29, 2024 • 6 • 1

kloodia/lora-8b-physic

Updated Apr 29, 2024 • 3

kloodia/lora-8b-medic

Updated Apr 29, 2024 • 2