hf-internal-testing
/

fuyu-tiny-tokenizer

Model card Files Files and versions

fuyu-tiny-tokenizer / tokenizer_config.json

Commit History

Update tokenizer_config.json: 760-token vocab with all 256 byte tokens

d2b6739
verified

hf-transformers-bot commited on Jun 30

Update tokenizer_config.json

9e90e0b
verified

hf-transformers-bot commited on Jun 30

Add tiny Fuyu tokenizer fixture for testing

8393b8f
verified

hf-transformers-bot commited on Jun 30