Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,080

Base only

Active filters: 8-bit

RyanJT/trained-quant-8bit

3B • Updated Jun 23, 2024

bigstorm/Hermes-2-Theta-Llama-3-8B-8.0bpw-8hb-exl2

Text Generation • Updated Jun 23, 2024 • 1

q18/sophosympatheia-New-Dawn-Llama-3-70B-32K-v1.0-exl2-8.0bpw-h8

Text Generation • Updated Jun 23, 2024 • 2 • 1

bigstorm/Codestral-22B-v0.1-8.0bpw-8hb-exl2

Text Generation • Updated Jun 23, 2024

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Text Generation • 8B • Updated Oct 9, 2024 • 10

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token-2048-Samples

Text Generation • 8B • Updated Oct 9, 2024 • 10

bigstorm/Yi-1.5-34B-Chat-16K-8.0bpw-8hb-exl2

Text Generation • Updated Jun 24, 2024

Bighost/Charpoet_8bit

Text Generation • 8B • Updated Jun 24, 2024 • 3

farshadafx/Phi3VisionX

Text Generation • Updated Feb 4, 2025 • 2 • 1

saicharan8/8-bit-telugu-bert

Feature Extraction • 0.1B • Updated Jun 24, 2024 • 3

bjaidi/Meta-Llama-3-8B-Instruct-GPTQ-8-bit

Text Generation • 8B • Updated Jun 24, 2024 • 1

bjaidi/Hermes-2-Theta-Llama-3-8B-GPTQ-8-bit

Text Generation • 8B • Updated Jun 24, 2024 • 3

bjaidi/Phi-3-medium-128k-instruct-GPTQ-8-bit

Text Generation • 14B • Updated Jun 25, 2024 • 3

QuantiPhy/aya-23-8B-8bq

Text Generation • 8B • Updated Jun 25, 2024 • 4

acl-srw-2024/mistral-7b-unsloth-gptq-8bit

Text Generation • Updated Jun 26, 2024 • 2

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8

Text Generation • Updated Jun 25, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation • 8B • Updated Oct 9, 2024 • 21

BornSaint/open_cabra-pt-br-3B_v2_base_model

Text Generation • 3B • Updated Jun 25, 2024 • 4

BigHuggyD/alpindale_magnum-72b-v1_exl2_8.0bpw_h8

Text Generation • Updated Jun 26, 2024 • 3

Truepeak/ORPO-PM01-0.4-full

Feature Extraction • 8B • Updated Jun 26, 2024

Peaky8linders/isafpr-tiny-llama-lora

Updated Jun 27, 2024

unclecode/folrence-2-8bit

Image-Text-to-Text • 0.8B • Updated Jun 26, 2024 • 6

unclecode/folrence-2-large-8bit

Image-Text-to-Text • 0.8B • Updated Jun 26, 2024 • 3

bullerwins/Llama-3-Instruct-8B-SPPO-Iter3-exl2_8.0bpw

Text Generation • Updated Jun 26, 2024 • 1

bjaidi/Phi-3-medium-128k-instruct-GPTQ-8-bit-c4

Text Generation • 14B • Updated Jun 26, 2024 • 3

bjaidi/Phi-3-medium-128k-instruct-c4-32

Text Generation • 14B • Updated Jun 26, 2024 • 5

kurcontko/flan-t5-xxl-lora-samsum

11B • Updated Jun 27, 2024 • 9

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 2, 2024 • 1.29k • 13

John6666/gokaygokay-Florence-2-SD3-Captioner-8bit

Image-Text-to-Text • 0.3B • Updated Jun 27, 2024 • 18 • 2

Persival123/appleHelper-mistral-7b-finetuned

Text Generation • 7B • Updated Jun 27, 2024 • 4