geodesic-research
/

nemotron-instruct-tokenizer

Model card Files Files and versions

nemotron-instruct-tokenizer

Commit History

Apr 26

19:44
Add special_tokens_map.json for transformers 4.x compatibility

Kyle1668

Verified signature
c1685dd
19:43
Add detailed README documenting changes vs upstream Nemotron tokenizer

Kyle1668

Verified signature
20224f1
19:43
Initial upload: instruct-only Nemotron tokenizer (no think-tag injection)

Kyle1668

Verified signature
0739f2f
19:42
initial commit

Kyle1668

Verified signature
baf3c80