Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
rafal-adamczyk
/
polish-morphological-tokenizer
Like
0
Polish
custom
tokenizer
polish
bpe
morphological
subword
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
polish-morphological-tokenizer
1.94 MB
Ctrl+K
Ctrl+K
1 contributor
History:
8 commits
rafal-adamczyk
Upload tokenizer.py with huggingface_hub
73eccc1
verified
10 months ago
pl_things
Upload folder using huggingface_hub
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
3.32 kB
Upload README.md with huggingface_hub
10 months ago
tokenizer.py
Safe
30.1 kB
Upload tokenizer.py with huggingface_hub
10 months ago
trie.py
Safe
1.85 kB
Upload trie.py with huggingface_hub
10 months ago
vocab.json
Safe
1.89 MB
Upload vocab.json with huggingface_hub
10 months ago
