MMLU-by-task-Leaderboard / test_details_data_processing.py

Commit History

  1. added a test

    Corey Morris
    a13887a

  1. WIP. Updated download file. Can now download all files. Need to integrate that code to loop through all files to download or combine files first into a single dataframe and then save that

    Corey Morris
    0a77c60
  2. added new test for a file that currently can be downloaded

    Corey Morris
    6251f5a
  3. Replicating 404 error with a test so I can troubleshoot

    Corey Morris
    9adae3c
  4. Updated download_file method

    Corey Morris
    b58e1f0
  5. Build URL from file path is working

    Corey Morris
    cc32c4f
  6. Find files is working as expected

    Corey Morris
    30fa96a
  7. WIP commit. Finding files can be identical as the method in results_data_processor.

    Corey Morris
    c32735e
  8. added mostly hardcoded generate url method and test

    Corey Morris
    83a34f0

  1. Added download file method and test

    Corey Morris
    513e813
  2. Added basic structure of details data processing and testing. For downloading huggingface details dataset files

    Corey Morris
    ee9e25e