Model card: the command and the recipe
Browse files
README.md
CHANGED
|
@@ -48,19 +48,14 @@ Built and tested on Radeon AI PRO R9700 (gfx1201).
|
|
| 48 |
|
| 49 |
## How this file was made
|
| 50 |
|
| 51 |
-
The exact command, with the radiance image built by `docker/build.sh` from radiance commit 93bbe22:
|
| 52 |
-
|
| 53 |
```sh
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
--
|
| 57 |
-
--recipe /opt/radiance/share/radiance/recipes/minicpm5-2b-bf16-dspark.recipe \
|
| 58 |
-
-o /models/rad/minicpm5-2b-bf16.rad
|
| 59 |
```
|
| 60 |
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
records them (`rad-info --recipe minicpm5-2b-bf16.rad`), quantise the drafter only:
|
| 64 |
|
| 65 |
```
|
| 66 |
dspark.draft_head.weight rtn codes=u2 zero=u8 group=128 scale=f16
|
|
|
|
| 48 |
|
| 49 |
## How this file was made
|
| 50 |
|
|
|
|
|
|
|
| 51 |
```sh
|
| 52 |
+
rad-convert openbmb/MiniCPM5-2B --draft-model openbmb/MiniCPM5-2B-DSpark \
|
| 53 |
+
--tokenizer openbmb/MiniCPM5-2B/tokenizer.json \
|
| 54 |
+
--recipe minicpm5-2b-bf16-dspark.recipe -o minicpm5-2b-bf16.rad
|
|
|
|
|
|
|
| 55 |
```
|
| 56 |
|
| 57 |
+
The recipe (`minicpm5-2b-bf16-dspark.recipe` in this repository) quantises the drafter only;
|
| 58 |
+
everything it does not name is the checkpoint's bf16:
|
|
|
|
| 59 |
|
| 60 |
```
|
| 61 |
dspark.draft_head.weight rtn codes=u2 zero=u8 group=128 scale=f16
|