Edit Models filters

Showing models from

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

21

Base only

Active filters: hugging-quants

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 321k • 95

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 42.1k • 53

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 410B • Updated Sep 13, 2024 • 634 • 38

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 60.2k • 111

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • 410B • Updated Aug 7, 2024 • 100 • 17

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • 418B • Updated Sep 16, 2024 • 120 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • 423B • Updated Sep 16, 2024 • 20 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 174 • 8

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 15 • 1

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 833 • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 1.62k • 42

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • 117B • Updated Sep 16, 2024 • 94 • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • 3B • Updated Jul 28, 2024 • 12

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • 21B • Updated Aug 8, 2024 • 13 • 2

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 41.3k • 36

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 8.51k • 50

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.35k • 53

hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4

Text Generation • 47B • Updated Oct 7, 2024 • 2.74k

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • 9B • Updated Oct 17, 2024 • 802k • 10

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • 109B • Updated Apr 9, 2025 • 18 • 2

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • 109B • Updated Apr 9, 2025 • 15 • 2