Spaces:
Running on Zero
Running on Zero
Commit History
-
Clarify PyPI usage Running
45c6078
-
Require ctok 1.1.0
The vocab figures come from len(pieces(...)), so the Space picks up 48,787 v3 and 15,280 v4.7 pieces on the next build with no code change. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>1a45ca6
-
Document the marker notation
Verified signaturef3775d9 -
Separate adjacent byte markers
Verified signaturef9f1aef -
Blog notation for markers, no toggle
Verified signature4c720a7 -
Keep word spacing when markers are hidden
Verified signature173ddf7 -
Mobile-friendly layout
Verified signature81723d3 -
Number each article once
Verified signature3e56579 -
Correctness, RTL and performance fixes
Verified signature4a15d75 -
Seven languages, one sentence each
Verified signaturee69c434 -
UDHR articles 1-5, one language each
Verified signature68ab539 -
Six UDHR articles as the lead example
Verified signature00724b5 -
Cleaner table, links, and examples worth reading
Verified signature4b80632 -
Link the source, the package and the writeup
Verified signature1ced414 -
Retitle around Claude
Verified signatureaa492c1 -
Tokenizer comparison app
Verified signature0d3e580 -
initial commit
Verified signature1f75a17