Post
373
tokenizers 0.23.3 is out!https://github.com/huggingface/tokenizers/releases/tag/v0.23.3
The release is python-only and fixes a few very annoying issues
AI & ML interests
None defined yet.
https://github.com/huggingface/tokenizers/releases/tag/v0.23.3
The release is python-only and fixes a few very annoying issues
Post
330
I put together a Space to showcase tokenization-in-the-browser libs we maintain at HF
Let me know what you think!
sbrandeis/tokenizers-wasm-demo
Let me know what you think!
sbrandeis/tokenizers-wasm-demo
sbrandeis
authored a
paper about 3 years ago
sbrandeis
authored a
paper over 3 years ago