The Functionalizer: Lossless Functional Decomposition for Subword Tokenization
Paper • 2609.15991 • Published • 17
Functionalizer-100M
-
-
mrkwanzaa/functionalizer-100M-fineweb-edu-seed1
Text Generation • 97.7M • Updated • 357 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed2
Text Generation • 97.7M • Updated • 379 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed3
Text Generation • 97.7M • Updated • 366 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed4
Text Generation • 97.7M • Updated • 354 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed5
Text Generation • 97.7M • Updated • 381 -
mrkwanzaa/functionalizer-100M-github-code-python-seed1
Text Generation • 97.7M • Updated • 425 -
mrkwanzaa/functionalizer-100M-github-code-python-seed2
Text Generation • 97.7M • Updated • 435 -
mrkwanzaa/functionalizer-100M-github-code-python-seed3
Text Generation • 97.7M • Updated • 432 -
mrkwanzaa/functionalizer-100M-github-code-python-seed4
Text Generation • 97.7M • Updated • 421 -
mrkwanzaa/functionalizer-100M-github-code-python-seed5
Text Generation • 97.7M • Updated • 426