Spaces:
Sleeping
Sleeping
Commit History
-
Add barchart showing shortest/longest median tokenized text
Verified signature40b05d1 -
Update app.py
Verified signature111053f -
Update app.py
Verified signature94a7df7 -
Update requirements.txt
Verified signature6dcf310 -
update huggingface package
Verified signature803e0b6 -
update streamlit
Verified signature1f834cd -
fix tabs
Verified signaturecb5b76e -
fix tab
Verified signatureba38c3f -
Upload 2 files
Verified signature8c475b6
-
Updating link to blog in app
c4e64d6 -
Updating link to blog post
e7c169f
-
Updating the About the Project section
Yennie Jun96bd252
-
Adding yaml to top of README
21a3b4f
-
Merge branch 'main' of https://github.com/yenniejun/tokenizers-languages into main
7b528cd -
Adding images for README
cd2f205 -
Modifying README
ac19006 -
Adding license
18991e3 -
Merge pull request #1 from yenniejun/yenniejun-patch-1
Unverified signatureCreate sync_hf_hub.yaml for syncing repo to HFdc53228 -
Create sync_hf_hub.yaml for syncing repo to HF
Unverified signatureFollowing instructions from https://docs.github.com/en/repositories/working-with-files/managing-files/creating-new-files and https://huggingface.co/docs/hub/spaces-github-actions701efbc
-
Rearranging some of the figures
5943f5c
-
Rename text in button for refreshing
26e280e -
Adding example texts to show
62551b2
-
Update explanation message and link to amazon
8641796 -
Adding explanation for project
616477f -
Remove divider
fe5c81b -
Update small formatting things:
c1ad373 -
Make label visibility collapsed for some options
aaff21f -
clean up the figure, add data caching, add headers
535e678 -
update code to match updated data with pre-calculated token lens
29daff8 -
Updating data file with tokenizer token numbers
0a9ef68 -
Adding requirements
fdbf317 -
rename to app.py
87987fe -
Adding main file
d0ab3b0 -
Adding dataset
8a3ab6c
-
initial commit
3cccf5e