Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

205

Base only

Active filters: hqq

prism-ml/bonsai-image-binary-4B-gemlite-1bit

Text-to-Image • Updated Jun 1 • 419 • 47

mlabonne/AlphaMonarch-7B-2bit-HQQ

Text Generation • Updated Mar 28, 2024 • 7 • 7

speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ

Text Generation • Updated Apr 4, 2024 • 6 • 1

mayflowergmbh/occiglot-7b-de-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 2

mayflowergmbh/occiglot-7b-es-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 2

mayflowergmbh/occiglot-7b-eu5-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 2

mayflowergmbh/occiglot-7b-fr-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 2

mayflowergmbh/occiglot-7b-it-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 2

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 6 • 1

mayflowergmbh/SauerkrautLM-7b-LaserChat-HQQ

Text Generation • Updated Apr 19, 2024 • 6

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-HQQ

Text Generation • Updated Apr 26, 2024 • 1

mayflowergmbh/Llama3_DiscoLM_German_8b_v0.1_experimental-HQQ

Text Generation • Updated Apr 26, 2024 • 2

webbigdata/C3TR-Adapter_hqq

Translation • Updated May 24, 2024 • 1

aspirina765/Daredevil-8B-abliterated-2bit-HQQ

Text Generation • Updated Jun 9, 2024 • 4 • 3

nm-testing/Llama-3.2-1B-Instruct-HQQ

0.8B • Updated Oct 30, 2024

alpindale/magnum-v4-123b-hqq-4bit

64B • Updated Nov 3, 2024 • 7 • 1

PyrTools/Cydonia-22B-v1.2-HQQ-4bit

12B • Updated Nov 3, 2024 • 5

fayez-siddiqui/Llama3_8b_HQQ-1bit

Text Generation • 2B • Updated Nov 6, 2024 • 5

fayez-siddiqui/Llama3_8b_HQQ-4bit

Text Generation • 5B • Updated Nov 6, 2024 • 5

fayez-siddiqui/Llama3_8b_HQQ-2bit

Text Generation • 3B • Updated Nov 6, 2024 • 3

gurro/Llama-3.1-8B_hqq_4bit

Updated Nov 29, 2024 • 4

gurro/llama-3.1-8B-hqq-int3-g64

Updated Dec 1, 2024 • 1

gurro/llama-3.1-8B-hqq-int2-g32

Updated Dec 1, 2024 • 3

gurro/llama-3.1-8B-hqq-int3-g32

Updated Dec 1, 2024 • 4

domlc/llava-11b-cot-hqq

11B • Updated Dec 3, 2024 • 1

gurro/Llama-3.1-8B_hqq_nbits2_for_bitblas

Updated Dec 8, 2024 • 4

gurro/Llama-3.1-8B_hqq_nbits2_g32_latest

Updated Dec 8, 2024 • 4

AminBH/Llama-3-8B-HQQ-2bit

Updated Dec 26, 2024 • 5

rohan700/TinyLlama-1.1B-Chat-v1.0-4bit-HQQ

Updated Jan 27, 2025 • 5

dropbox-dash/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • 5B • Updated May 23, 2025 • 13 • 2