Commit History

  1. Mark leaderboard as deprecated

    d457559
  2. Mark leaderboard as deprecated

    bcd959b

  1. update citation

    7613266

  1. handle different version names in dataset and in storage

    0dfb8fc

  1. update text

    c7b592e
  2. remove v2

    98c84f9
  3. update text

    3ab0825
  4. add default tab v2 in leaderboard

    088114e
  5. update eval logging

    e650796
  6. update eval logging

    0b8f0ae
  7. clean up model counting

    bf018b4
  8. fix when counting subm models

    133e122
  9. minor fix in desc

    15c4da2
  10. minor fix in desc

    e9cd8a6
  11. Add dataset versioning support and update leaderboard configuration

    bea3aa3

  1. Add report file link to leaderboard and update column definitions

    700ac84

  1. Sort leaderboard entries by "Final Solution Accuracy" in hf_utils.py

    43dd2bb

  1. Fix indexing for leaderboard columns in hf_utils.py

    a6f5bd8
  2. Add base LLM and modelling framework to submission metadata; update leaderboard columns

    444cb2e
  3. Fix error percentage calculation in user_eval.py

    0030c6c
  4. Update README.md with project structure and development instructions; fix error percentage calculation in user_eval.py

    2990bc2
  5. Refactor evaluation logic: streamline user_eval.py, update evaluation script references, and clean up eval.py

    70cc330

  1. update leaderboard entry parsing, enhance LLM client configuration, and correct submission file link

    60a95c1
  2. update leaderboard columns and enhance evaluation summary reporting

    2e2392c
  3. add dataset citation

    bb9ae17

  1. update submission guidelines in UI text and add template script link

    a119cd7
  2. remove unused constants and redundant imports; update Dockerfile dependencies

    5e53d23
  3. fix missing dirs

    1cb4bfb
  4. remove subprocess

    ecfa9d2
  5. minor changes

    f021e7d
  6. minor changes

    15bdc2b
  7. add creation of dir 2

    7824912
  8. restore temp dir

    4aab7ea
  9. restore temp dir

    8b3ba2f
  10. deb

    823637b
  11. deb

    3852c4d
  12. deb

    752c498
  13. deb

    03bca85
  14. fix not downloading the metadata

    308cfba
  15. attemp to install mnz from app.py

    aa8b25c
  16. try to fix minizinc not found in path

    3d86f3e
  17. add minizinc

    e67d561

  1. add user eval

    27b03dc
  2. change submission from directory to a single jsonl file

    21ed616
  3. add extra hf dataset for persistent storage of submissions and results

    180f9fe

  1. clean up and update README.md

    816a13f
  2. add new submission tab

    2862155
  3. update intro text

    a99b397

  1. Duplicate from demo-leaderboard-backend/leaderboard⁠

    kostis-init +1: clefourrier
    Verified signature
    36ea38b