Hugging Face's logo

Spaces:
CoreyMorris
/
MMLU-by-task-Leaderboard
Sleeping

App Files Community
4
MMLU-by-task-Leaderboard / details_data_processor.py

Commit History

  1. updated pipeline and init

    Corey Morris
    7f2d984

  2. removed commented code

    Corey Morris
    2f457d8

  3. shortened file name

    Corey Morris
    7622af3

  4. shortened file name

    Corey Morris
    38d88f9

  5. using URL as file name

    Corey Morris
    25b87bf

  1. WIP. Updated download file. Can now download all files. Need to integrate that code to loop through all files to download or combine files first into a single dataframe and then save that

    Corey Morris
    0a77c60

  2. Replicating 404 error with a test so I can troubleshoot

    Corey Morris
    9adae3c

  3. Updated download_file method

    Corey Morris
    b58e1f0

  4. Build URL from file path is working

    Corey Morris
    cc32c4f

  5. moved methods to better match flow

    Corey Morris
    f228d38

  6. removed most commented out code from details processor

    Corey Morris
    74822dd

  7. Find files is working as expected

    Corey Morris
    30fa96a

  8. WIP commit. Finding files can be identical as the method in results_data_processor.

    Corey Morris
    c32735e

  9. added mostly hardcoded generate url method and test

    Corey Morris
    83a34f0

  1. Added download file method and test

    Corey Morris
    513e813

  2. Added basic structure of details data processing and testing. For downloading huggingface details dataset files

    Corey Morris
    ee9e25e