Spaces:
Running
Running
Commit History
-
Fix bug that _temp_run can't be pickled; Pass indices to allow evaluation on a subset of problems
* Bug fix: I always got a runtime error when evaluating any solution. The reason seems to be that `_temp_run` is inside `check_correctness` in `utils.py`. Moving it out of `check_correctness` solves the problem. * Feature: The _compute function in apps_metric.py accepts an `indices` argument, which is a list of indices of problems to be evaluated. This can be useful if we only want to evaluate solutions to a few problems in APPS, but not all of them. I have to admit that I haven't created a PR on HF before. I did fork this first (https://huggingface.co/spaces/shunzh/apps_metric), but it seems that PR is not based on a fork, and I can upload files directly here? Also, let me know if there's a template that I should use for PR (I couldn't find one) or if this message is clear. Thanks!3adfe29
-
hide debugging comment
2a1d3d6
-
update check_correctness
91d44ed -
add global timeout check
942b4fc
-
Update utils.py
211dadd -
Update utils.py
e3de641
-
Update utils.py
f117372 -
Update utils.py
b73b144 -
Update utils.py
0535e18
-
Update utils.py
9f92296 -
Update utils.py
4b9354a -
Update utils.py
73f421f
-
remove print
2b593f3 -
Update utils.py
c8dabd1 -
update import
6d999ce -
Update utils.py
6256baf -
Update utils.py
4e380a4 -
update import
e7c6c43 -
change location of utils files
819e86a
-
update utils
5b35821 -
add files
e21caa2