axteam/MiniCPM5-2B-FP8-dynamic

Text Generation • 3B • Updated 3 days ago • 25 • 1

Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM

axteam/MiniCPM5-2B-AWQ-8bit

Text Generation • 3B • Updated 3 days ago • 24 • 2

Note AWQ INT8 (W8A16) — near-lossless 8-bit

axteam/MiniCPM5-2B-NVFP4A16

Text Generation • 3B • Updated 3 days ago • 79 • 1

Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality

axteam/MiniCPM5-2B-AWQ-4bit

Text Generation • 3B • Updated 3 days ago • 27 • 1

Note AWQ INT4 (W4A16)

axteam/MiniCPM5-2B-NVFP4

Text Generation • 3B • Updated 3 days ago • 80 • 1

Note NVFP4 W4A4 (FP4 weights+act) — Blackwell

axteam/MiniCPM5-2B-GGUF

3B • Updated 3 days ago • 85 • 2

Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama

axteam/MiniCPM-V-4.7-35B-A3B-FP8-dynamic

Image-Text-to-Text • 35B • Updated 3 days ago • 22 • 1

Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM

axteam/MiniCPM-V-4.7-35B-A3B-AWQ-8bit

Image-Text-to-Text • 11B • Updated 3 days ago • 24 • 1

Note AWQ INT8 (W8A16) — near-lossless 8-bit

axteam/MiniCPM-o-4_5-FP8-dynamic

Any-to-Any • 9B • Updated 3 days ago • 25 • 1

Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM

axteam/MiniCPM-V-4.7-35B-A3B-NVFP4A16

Image-Text-to-Text • 21B • Updated 3 days ago • 31 • 1

Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality

axteam/MiniCPM-V-4.7-35B-A3B-AWQ-4bit

Image-Text-to-Text • 7B • Updated 3 days ago • 22 • 1

Note AWQ INT4 (W4A16)

axteam/MiniCPM-V-4.7-35B-A3B-NVFP4

Image-Text-to-Text • 21B • Updated 3 days ago • 25 • 1

Note NVFP4 W4A4 (FP4 weights+act) — Blackwell