Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,936

Base only

Active filters: bitsandbytes

RichardErkhov/HuggingFaceH4_-_starchat2-15b-sft-v0.1-4bits

Text Generation • 16B • Updated May 1, 2024 • 17

RichardErkhov/HuggingFaceH4_-_starchat2-15b-sft-v0.1-8bits

Text Generation • 16B • Updated May 1, 2024 • 16

theGhoul21/srl-sft-010524-4bit

Text Generation • 7B • Updated May 1, 2024 • 13

kloodia/llama-8x8-qlora-alpaca

Updated May 1, 2024 • 8

gen-bi/llama-2-ko-juno-7b

Text Generation • 7B • Updated May 1, 2024 • 14

neph1/llama-3-instruct-bellman-8b-swedish

Text Generation • 8B • Updated Jul 24, 2024 • 249 • 2

RichardErkhov/ABX-AI_-_Spicy-Laymonade-7B-4bits

Text Generation • 7B • Updated May 1, 2024 • 13

RichardErkhov/RobertML_-_sn6e-4bits

Text Generation • 2B • Updated May 1, 2024 • 13

RichardErkhov/RobertML_-_sn6e-8bits

Text Generation • 2B • Updated May 1, 2024 • 14

RichardErkhov/Undi95_-_Llama-3-Unholy-8B-4bits

Text Generation • 8B • Updated May 1, 2024 • 15

RichardErkhov/ABX-AI_-_Spicy-Laymonade-7B-8bits

Text Generation • 7B • Updated May 1, 2024 • 16

RichardErkhov/Undi95_-_Llama-3-Unholy-8B-8bits

Text Generation • 8B • Updated May 1, 2024 • 13

rachid16/llama3-8b-RAG-News-Finance

Text Generation • Updated May 4, 2024 • 12

RichardErkhov/CreitinGameplays_-_bloom-3b-conversational-4bits

Text Generation • 3B • Updated May 1, 2024 • 30

RichardErkhov/BearNetworkChain_-_BRNKCForCausalLM-4bits

Text Generation • 0.7B • Updated May 1, 2024 • 13

RichardErkhov/BearNetworkChain_-_BRNKCForCausalLM-8bits

Text Generation • 0.7B • Updated May 1, 2024 • 18

RichardErkhov/CreitinGameplays_-_bloom-3b-conversational-8bits

Text Generation • 3B • Updated May 1, 2024 • 28

C-Stuti/llama3-8b

Text Generation • 8B • Updated May 1, 2024 • 10

RichardErkhov/PathFinderKR_-_Waktaverse-Llama-3-KO-8B-Instruct-4bits

Text Generation • 8B • Updated May 1, 2024 • 16

RichardErkhov/RobertML_-_sn666-4bits

Text Generation • 2B • Updated May 1, 2024 • 15

RichardErkhov/RobertML_-_sn666-8bits

Text Generation • 2B • Updated May 1, 2024 • 14

RichardErkhov/PathFinderKR_-_Waktaverse-Llama-3-KO-8B-Instruct-8bits

Text Generation • 8B • Updated May 1, 2024 • 16

RichardErkhov/yhavinga_-_Boreas-7B-4bits

Text Generation • 7B • Updated May 1, 2024 • 13

RichardErkhov/yhavinga_-_Boreas-7B-8bits

Text Generation • 7B • Updated May 1, 2024 • 13

RichardErkhov/yhavinga_-_Boreas-7B-chat-4bits

Text Generation • 7B • Updated May 1, 2024 • 11

RichardErkhov/yhavinga_-_Boreas-7B-chat-8bits

Text Generation • 7B • Updated May 1, 2024 • 13

srbdtwentyfour/mystery-llama-3-8b-4-bit

Text Generation • 8B • Updated May 1, 2024 • 12

RichardErkhov/kalytm_-_nous-4-4bits

Text Generation • 2B • Updated May 1, 2024 • 13

RichardErkhov/kalytm_-_nous-4-8bits

Text Generation • 2B • Updated May 1, 2024 • 14

RichardErkhov/kalytm_-_nous-14-4bits

Text Generation • 2B • Updated May 1, 2024 • 15