Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,802

Base only

Active filters: bitsandbytes

yongsun-shim/eeve-8bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 5

ai-er/llama-2-medi-dialog-mini-finetuned

Text Generation • 7B • Updated Apr 15, 2024 • 5

yongsun-shim/eeve-4bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 6

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 5

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 4

shrenikb/sparseLAMA

Text Generation • 7B • Updated Apr 15, 2024 • 6

yongsun-shim/eeve-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 8

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 4

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-alpha-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 5

yongsun-shim/eeve-4bit-test-3

Text Generation • 11B • Updated Apr 15, 2024 • 5

yongsun-shim/solar-4bit-test-1

Text Generation • 11B • Updated Apr 15, 2024 • 5

yongsun-shim/solar-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 5

RichardErkhov/HuggingFaceH4_-_starchat-beta-4bits

Text Generation • 16B • Updated May 1, 2024 • 8

RichardErkhov/HuggingFaceH4_-_starchat-beta-8bits

Text Generation • 16B • Updated May 1, 2024 • 5

rahulvramesh/tinyllama-colorist-v1

Text Generation • 1B • Updated Apr 15, 2024 • 4

singhjagpreet/math_instruct

Text Generation • 3B • Updated Apr 17, 2024 • 6

abdullahfurquan/codegen-350M-mono-python-18k-alpaca

Text Generation • 7B • Updated Apr 15, 2024 • 2

Manju7/mistral-fmla_qa-Finetuned_with_quantv1

Text Generation • 7B • Updated Apr 15, 2024 • 4

axlesubash/phi2-email-qlora

Text Generation • 3B • Updated Apr 15, 2024 • 4

Jooonhan/mistral_7b_instruct_summarization_v2_merged_peft

Text Generation • 7B • Updated Apr 15, 2024 • 4

jaryong/llama-2-ko-7b-chat-itaz-v0.2

Text Generation • 7B • Updated Apr 15, 2024 • 3

RichardErkhov/HuggingFaceH4_-_starchat-alpha-4bits

Text Generation • 16B • Updated May 1, 2024 • 7

RichardErkhov/HuggingFaceH4_-_starchat-alpha-8bits

Text Generation • 16B • Updated May 1, 2024 • 7

daanjiri/Biomistral_7b_bhc_5

Text Generation • Updated Apr 15, 2024 • 4

sosoai/hansoldeco-mixtral-8x22b-4bit-v0.1

Text Generation • 145B • Updated Apr 15, 2024 • 4

dbaek111/Llama-2-7b-chat-hf-Elon_Interview_407-merged

Text Generation • 7B • Updated Apr 16, 2024

anupam413/phi2_qlora_emailGen_bitsandbytes

Text Generation • 3B • Updated Apr 17, 2024 • 2

bluedoumi/llama-2-7b-chat-hkcode-kor

Text Generation • 7B • Updated Apr 16, 2024 • 5

samyukthacodes/mental-health-mistral-7b-instructv0.2-finetuned-V2_merged

Text Generation • 7B • Updated Apr 16, 2024 • 5

dbaek111/Llama-2-7b-chat-hf-Elon_Interview_70-merged

Text Generation • 7B • Updated Apr 16, 2024