Model card: the command and the recipe
Browse files
README.md
CHANGED
|
@@ -48,30 +48,14 @@ Built and tested on Radeon AI PRO R9700 (gfx1201).
|
|
| 48 |
|
| 49 |
## How this file was made
|
| 50 |
|
| 51 |
-
The exact command, run on 2026-10-01 from a radiance build directory (`radiance_home` is that
|
| 52 |
-
build's plugin directory):
|
| 53 |
-
|
| 54 |
-
```sh
|
| 55 |
-
./bin/rad-convert ~/models/openbmb/MiniCPM5-2B -o ~/models/rad/minicpm5-2b-dspark.v2.rad \
|
| 56 |
-
--home radiance_home --tokenizer ~/models/openbmb/MiniCPM5-2B/tokenizer.json \
|
| 57 |
-
--draft-model ~/models/openbmb/MiniCPM5-2B-DSpark --recipe ../data/recipes/minicpm5-2b-dspark.recipe
|
| 58 |
-
```
|
| 59 |
-
|
| 60 |
-
The published file is that output under this repository's name, with the local directory removed
|
| 61 |
-
from the `created by` string in its header; the weights are the converter's bytes. The same
|
| 62 |
-
conversion with the radiance image (`docker/build.sh` in the radiance repository, commit 93bbe22)
|
| 63 |
-
reproduces them byte for byte:
|
| 64 |
-
|
| 65 |
```sh
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
--
|
| 69 |
-
--recipe /opt/radiance/share/radiance/recipes/minicpm5-2b-dspark.recipe \
|
| 70 |
-
-o /models/minicpm5-2b-fp8.rad
|
| 71 |
```
|
| 72 |
|
| 73 |
-
The recipe
|
| 74 |
-
|
| 75 |
|
| 76 |
```
|
| 77 |
output.weight rtn codes=fp8_e4m3 block=128x128 scale=bf16
|
|
|
|
| 48 |
|
| 49 |
## How this file was made
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
```sh
|
| 52 |
+
rad-convert openbmb/MiniCPM5-2B --draft-model openbmb/MiniCPM5-2B-DSpark \
|
| 53 |
+
--tokenizer openbmb/MiniCPM5-2B/tokenizer.json \
|
| 54 |
+
--recipe minicpm5-2b-dspark.recipe -o minicpm5-2b-fp8.rad
|
|
|
|
|
|
|
| 55 |
```
|
| 56 |
|
| 57 |
+
The recipe (`minicpm5-2b-dspark.recipe` in this repository); everything it does not name is
|
| 58 |
+
the checkpoint's own:
|
| 59 |
|
| 60 |
```
|
| 61 |
output.weight rtn codes=fp8_e4m3 block=128x128 scale=bf16
|