Hugging Face's logo

Spaces:
toksuite
/
quick-tokenizer-accuracy
Runtime error

App Files Community
quick-tokenizer-accuracy

Commit History

  1. Update supertoken.py

    gsaltintas
    Verified signature
    cf73d0b

  1. Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy

    Gül Sena Altıntaş
    b1c588a

  2. Merged readme

    Gül Sena Altıntaş
    c34a637

  3. Updated hf paths for toksuite models

    Gül Sena Altıntaş
    5d0049d

  1. Update README.md

    gsaltintas
    Verified signature
    4bdfefb

  1. - Added summary that could be directly copy pasted into sheets

    Gül Sena Altıntaş
    9cada5f

  1. - Save with prefix⁠

    Gül Sena Altıntaş
    b3de8c3

  1. Fixed issue with tokenmonster and tekken tokenizers

    Gül Sena Altıntaş
    431425d

  2. UI updates

    Gül Sena Altıntaş
    41156f1

  1. Now accepts multiline!

    Gül Sena Altıntaş
    15729bc

  2. Fixed Farsi copy-paste error, Coding [WIP]

    Gül Sena Altıntaş
    279fdab

  1. - Removed header⁠

    Gül Sena Altıntaş
    93f64e6

  1. Updated app for summary markdown tables

    Gül Sena Altıntaş
    6c9db61

  2. Fixed hf issue, fixed OOM

    Gül Sena Altıntaş
    6383574

  3. Fixed issue with job_id

    Gül Sena Altıntaş
    fb396ec

  4. Improved serving script⁠

    Gül Sena Altıntaş
    889a42a

  1. Killarney script

    Gül Sena Altıntaş
    1d3a5fe

  1. Fixed supertoken tokenizer loading

    Gül Sena Altıntaş
    cb0e70e

  1. Updated script a bit

    Gül Sena Altıntaş
    aebf6ac

  2. Added app⁠

    Gül Sena Altıntaş
    7ebe82f

  1. initial commit

    gsaltintas
    Verified signature
    b318650