Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
Duplicated from
Xenova/the-tokenizer-playground
PeterPinetree
/
TokenVisualizer
Like
1
Running
App
Files
Files
Community
main
TokenVisualizer
/
assets
/
gpt2
3.36 MB
Ctrl+K
Ctrl+K
2 contributors
History:
2 commits
PeterPinetree
Upload 5 files
aa67584
verified
over 1 year ago
.gitkeep
0 Bytes
Create gpt2/.gitkeep
over 1 year ago
merges.txt
456 kB
Upload 5 files
over 1 year ago
special_tokens_map.json
99 Bytes
Upload 5 files
over 1 year ago
tokenizer.json
2.11 MB
Upload 5 files
over 1 year ago
tokenizer_config.json
234 Bytes
Upload 5 files
over 1 year ago
vocab.json
798 kB
Upload 5 files
over 1 year ago