Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,830

Base only

Active filters: bitsandbytes

RichardErkhov/google_-_codegemma-7b-it-4bits

Text Generation • 9B • Updated Apr 14, 2024 • 30

RichardErkhov/google_-_codegemma-7b-it-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 30

RichardErkhov/google_-_codegemma-7b-4bits

Text Generation • 9B • Updated Apr 14, 2024 • 31

RichardErkhov/google_-_codegemma-7b-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 30

mkeohane01/mistral-instruct-590

7B • Updated Apr 18, 2024

kaidens/WHaK_AIv1

Updated Apr 15, 2024 • 2

Ekhlass/phi2-flutter-q-docs

Text Generation • 3B • Updated Apr 14, 2024 • 7

RichardErkhov/google_-_codegemma-2b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 31

RichardErkhov/google_-_codegemma-2b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 24

daanjiri/Biomistral_7b_bhc_10

Text Generation • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v2-7b-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 4

RichardErkhov/databricks_-_dolly-v2-7b-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v2-3b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v2-3b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 6

RichardErkhov/databricks_-_dolly-v2-12b-4bits

Text Generation • 12B • Updated Apr 14, 2024 • 5

RichardErkhov/databricks_-_dolly-v1-6b-4bits

Text Generation • 6B • Updated Apr 14, 2024 • 6

Imadken/Mistral-7B-v0.1-platypus

Text Generation • Updated Apr 15, 2024 • 3

RichardErkhov/databricks_-_dolly-v2-12b-8bits

Text Generation • 12B • Updated Apr 14, 2024 • 4

RichardErkhov/databricks_-_dolly-v1-6b-8bits

Text Generation • 6B • Updated Apr 14, 2024 • 8

akumar23/mental-falcon-7b

Text Generation • Updated Apr 15, 2024 • 4

sosoai/unsloth-hansoldeco-mistral-7b-openhermes-mixed-lora-v0.1

Text Generation • 7B • Updated Apr 14, 2024 • 5

jhamel/rebel_fine_tune

Text Generation • 0.3B • Updated Apr 15, 2024 • 3

EdBerg/quotes_Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 14, 2024 • 2

yongsun-shim/eeve-8bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 5

ai-er/llama-2-medi-dialog-mini-finetuned

Text Generation • 7B • Updated Apr 15, 2024 • 5

yongsun-shim/eeve-4bit-test

Text Generation • 11B • Updated Apr 15, 2024 • 6

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-4bits

Text Generation • 7B • Updated Apr 15, 2024 • 4

RichardErkhov/HuggingFaceH4_-_mistral-7b-sft-beta-8bits

Text Generation • 7B • Updated Apr 15, 2024 • 3

shrenikb/sparseLAMA

Text Generation • 7B • Updated Apr 15, 2024 • 6

yongsun-shim/eeve-4bit-test-2

Text Generation • 11B • Updated Apr 15, 2024 • 7