Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
wonhui-labs
/
swt-tokenizer
Like
0
Follow
WONHUI
2
Token Classification
multilingual
tokenizer
sentencepiece
byte-fallback
License:
unknown
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
README: local AutoTokenizer loading; align contents table with repo
#1
by
diallomama
- opened
15 days ago
base:
refs/heads/main
←
from:
refs/pr/1
Discussion
Files changed
+72
-8
diallomama
WONHUI org
15 days ago
Hugging Face CLI
No description provided.
README: local AutoTokenizer loading; align contents table with repo
07aaa174
diallomama
changed pull request status to
merged
15 days ago
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment