KucLab commited on
Commit
b368da6
·
verified ·
1 Parent(s): dcd73c5

Remove legacy tokenizer meta

Browse files
Files changed (1) hide show
  1. meta.json +0 -13
meta.json DELETED
@@ -1,13 +0,0 @@
1
- {
2
- "special_tokens": [
3
- "[PAD]",
4
- "[BOS]",
5
- "[USER]",
6
- "[ASSISTANT]"
7
- ],
8
- "answer_ids": [
9
- 19,
10
- 20
11
- ],
12
- "vocab_size": 2048
13
- }