Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

282

Base only

Active filters: nanbeige

Nanbeige/Nanbeige4.2-3B

Text Generation • 4B • Updated 26 days ago • 89.8k • 815

Nanbeige/Nanbeige4.1-3B

Text Generation • 4B • Updated Mar 25 • 4.49k • • 1.17k

ProCreations/grug-3b

Text Generation • 4B • Updated Jul 26 • 214 • 29

Nanbeige/Nanbeige4.2-3B-FP8

Text Generation • 4B • Updated Aug 7 • 636 • 10

Nanbeige/Nanbeige4.2-3B-DSpark

Text Generation • 0.8B • Updated Aug 31 • 735 • 25

webmp3/Sakura-Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated 1 day ago • 919 • 1

TheBloke/Nanbeige-16B-Chat-32K-GGUF

Text Generation • 16B • Updated Nov 18, 2023 • 1.24k • 6

TheBloke/Nanbeige-16B-Chat-32K-GPTQ

Text Generation • 16B • Updated Nov 18, 2023 • 68 • 3

TheBloke/Nanbeige-16B-Base-32K-GGUF

Text Generation • 16B • Updated Nov 19, 2023 • 2k • 4

TheBloke/Nanbeige-16B-Base-GGUF

Text Generation • 16B • Updated Nov 19, 2023 • 1.33k • 1

TheBloke/Nanbeige-16B-Chat-GGUF

Text Generation • 16B • Updated Nov 19, 2023 • 614 • 1

TheBloke/Nanbeige-16B-Base-32K-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 69 • 1

TheBloke/Nanbeige-16B-Base-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 41 • 2

TheBloke/Nanbeige-16B-Chat-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 36 • 1

mradermacher/Nanbeige1.5-8B-Chat-GGUF

8B • Updated Dec 16, 2024 • 2.05k

tooktang/Nanbeige2-8B-Chat-GGUF

Text Generation • 8B • Updated Apr 10, 2024 • 55

Zoyd/Nanbeige_Nanbeige2-16B-Chat-2_2bpw_exl2

Question Answering • Updated May 24, 2024 • 9

Zoyd/Nanbeige_Nanbeige2-16B-Chat-2_5bpw_exl2

Question Answering • Updated May 24, 2024 • 7

Zoyd/Nanbeige_Nanbeige2-16B-Chat-3_0bpw_exl2

Question Answering • Updated May 24, 2024 • 10

Zoyd/Nanbeige_Nanbeige2-16B-Chat-3_5bpw_exl2

Question Answering • Updated May 24, 2024 • 9

Zoyd/Nanbeige_Nanbeige2-16B-Chat-3_75bpw_exl2

Question Answering • Updated May 24, 2024 • 7

Zoyd/Nanbeige_Nanbeige2-16B-Chat-4_0bpw_exl2

Question Answering • Updated May 24, 2024 • 12

Zoyd/Nanbeige_Nanbeige2-16B-Chat-4_25bpw_exl2

Question Answering • Updated May 24, 2024 • 12

Zoyd/Nanbeige_Nanbeige2-16B-Chat-5_0bpw_exl2

Question Answering • Updated May 24, 2024 • 12

Zoyd/Nanbeige_Nanbeige2-16B-Chat-6_0bpw_exl2

Question Answering • Updated May 24, 2024 • 22

Zoyd/Nanbeige_Nanbeige2-16B-Chat-6_5bpw_exl2

Question Answering • Updated May 24, 2024 • 11

Zoyd/Nanbeige_Nanbeige2-16B-Chat-8_0bpw_exl2

Question Answering • Updated May 24, 2024 • 11

Nanbeige/Nanbeige4-3B-Thinking-2510

Text Generation • Updated Oct 23, 2025 • 221 • 13

mradermacher/Nanbeige4-3B-Thinking-2510-GGUF

4B • Updated Oct 23, 2025 • 383

mradermacher/Nanbeige4-3B-Thinking-2510-i1-GGUF

4B • Updated Dec 10, 2025 • 657 • 1