# No code snippets available yet for this library.
# To use this model, check the repository files and the library's documentation.
# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.jsMiniCPM4-0.5B · RKLLM
Text generation on Rockchip RK3576 and RK3588, converted from openbmb/MiniCPM4-0.5B.
- Conversion toolkit: RKLLM Toolkit 1.3.0.
- Inputs / output: text → text.
- License:
apache-2.0; the upstream model card describes its terms and intended use.
Choose your files
Use the files for your board’s exact SoC. w4a16 uses 4-bit weights and 16-bit activations; w4a16_g128 adds a weight group size of 128. w8a8 uses 8-bit weights and activations. File size below is download size, not total runtime RAM.
| Board | Quantization | Size | Language model |
|---|---|---|---|
| RK3576 | w4a16_g128 |
0.47 GiB | MiniCPM4-0.5B_RK3576_w4a16_g128.rkllm |
| RK3576 | w8a8 |
0.58 GiB | MiniCPM4-0.5B_RK3576_w8a8.rkllm |
| RK3588 | w8a8 |
0.57 GiB | MiniCPM4-0.5B_RK3588_w8a8.rkllm |
Run on your board
With Docker installed on a matching Rockchip board, this example starts the RK3576 w4a16_g128 model and its API on port 8001:
sudo docker run --rm -d --name rkllm \
--privileged -v /dev:/dev -p 8001:8001 \
ghcr.io/hanzo-huang/rkllm-docker/llm/minicpm4-0.5b:rk3576-w4a16-g128
The image includes its model file. See rkllm-docker for API requests, other board variants, and configuration.
To download the files separately instead:
hf download HanzoHuang/MiniCPM4-0.5B-RKLLM \
RK3576/MiniCPM4-0.5B_RK3576_w4a16_g128.rkllm \
--local-dir ./models
These are native RKLLM/RKNN artifacts. Use a compatible RKLLM runtime and the model’s correct chat template when integrating them in another application.
Release notes
No per-variant board benchmark is published here. Quantized output may differ from the original model; check responses on your own workloads. Use the toolkit version listed above when checking runtime compatibility.
SHA-256 checksums
34060c78f36ee6ac2a772d5353d32d700fe940ea48564f083b8665a85fdc499c RK3576/MiniCPM4-0.5B_RK3576_w4a16_g128.rkllm
10f2bfa298b5a79077fc52f339ead0446e9e834632226a8bfcc3d003d42a0ba8 RK3576/MiniCPM4-0.5B_RK3576_w8a8.rkllm
fef1e215dfa69391d2c5da53eb918020419a71e6b3539d9ef91d56d956b602ea RK3588/MiniCPM4-0.5B_RK3588_w8a8.rkllm
Credits
Original model: openbmb/MiniCPM4-0.5B. Conversion tools: Rockchip RKLLM.
- Downloads last month
- 81
Model tree for HanzoHuang/MiniCPM4-0.5B-RKLLM
Base model
openbmb/MiniCPM4-0.5B