stefaniancu
/

rost-d6-base

Model card Files Files and versions

rost-d6-base / tokenizer

547 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

stefaniancu's picture

Upload tokenizer/tokenizer.pkl with huggingface_hub

1266c1b verified 3 months ago

token_bytes.pt

133 kB
xet

Upload tokenizer/token_bytes.pt with huggingface_hub 3 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
414 kB
xet

Upload tokenizer/tokenizer.pkl with huggingface_hub 3 months ago