StillDeadcode commited on
Commit
ef5a007
·
verified ·
1 Parent(s): 8188c21

Model card: the command and the recipe

Browse files
Files changed (1) hide show
  1. README.md +5 -10
README.md CHANGED
@@ -48,19 +48,14 @@ Built and tested on Radeon AI PRO R9700 (gfx1201).
48
 
49
  ## How this file was made
50
 
51
- The exact command, with the radiance image built by `docker/build.sh` from radiance commit 93bbe22:
52
-
53
  ```sh
54
- docker run --rm --user 1000:1000 -v ~/models:/models --entrypoint rad-convert radiance:93bbe224b392 \
55
- /models/openbmb/MiniCPM5-2B --draft-model /models/openbmb/MiniCPM5-2B-DSpark \
56
- --tokenizer /models/openbmb/MiniCPM5-2B/tokenizer.json \
57
- --recipe /opt/radiance/share/radiance/recipes/minicpm5-2b-bf16-dspark.recipe \
58
- -o /models/rad/minicpm5-2b-bf16.rad
59
  ```
60
 
61
- Running it twice gives byte-identical files. The recipe file the command names is in this
62
- repository as `minicpm5-2b-bf16-dspark.recipe`, with its comments. Its rules, as the container
63
- records them (`rad-info --recipe minicpm5-2b-bf16.rad`), quantise the drafter only:
64
 
65
  ```
66
  dspark.draft_head.weight rtn codes=u2 zero=u8 group=128 scale=f16
 
48
 
49
  ## How this file was made
50
 
 
 
51
  ```sh
52
+ rad-convert openbmb/MiniCPM5-2B --draft-model openbmb/MiniCPM5-2B-DSpark \
53
+ --tokenizer openbmb/MiniCPM5-2B/tokenizer.json \
54
+ --recipe minicpm5-2b-bf16-dspark.recipe -o minicpm5-2b-bf16.rad
 
 
55
  ```
56
 
57
+ The recipe (`minicpm5-2b-bf16-dspark.recipe` in this repository) quantises the drafter only;
58
+ everything it does not name is the checkpoint's bf16:
 
59
 
60
  ```
61
  dspark.draft_head.weight rtn codes=u2 zero=u8 group=128 scale=f16