Fetching metadata from the HF Docker repository...
Sep 15, 2024 10:32 add CoAct traj and fix viz page Sep 12, 2024 14:34 remove all the with hint result 14:23 add llama-3.1 result 14:15 rename OpenDevin to OpenHands Aug 1, 2024 01:19 add 2nd run --global
Jul 23, 2024 16:52 add gpt-4o-mini result Xingyao Wang
Jul 22, 2024 22:17 Revert "add result from gpt-4o-mini" Xingyao Wang
This reverts commit 3d406f52cf294d6dae0962dfbe2011b998d9224d. 15:10 add result from gpt-4o-mini Xingyao Wang
Jul 19, 2024 16:13 update the last missing instance Xingyao Wang
14:14 update result from pr2489 Xingyao Wang
Jul 18, 2024 14:29 remove keys Xingyao Wang
14:28 revoke keys Xingyao Wang
01:43 add gpqa result Xingyao Wang
Jul 16, 2024 17:55 update v1.8 perf Xingyao Wang
Jul 14, 2024 18:08 add result for v1.8 no-hint gpt4o Xingyao Wang
Jul 10, 2024 21:16 add v1.8 result Xingyao Wang
Jul 3, 2024 18:58 update results using new ver of swebench Xingyao Wang
Jul 2, 2024 02:18 add claude-3.5 result Xingyao Wang
Jul 1, 2024 22:13 update old result w/ swe-bench latest harness; Xingyao Wang
add v1.7-no-hint result for 4o; Jun 29, 2024 06:05 improved patch apply Xingyao Wang
00:41 improved patch apply Xingyao Wang
Jun 27, 2024 18:48 add report field Xingyao Wang
Jun 19, 2024 19:43 Add CodeAct 1.6 no hint Jun 13, 2024 01:10 feat: add gpqa results (#8 ) - feat: add gpqa results (ea5c515d7c8a0916c9838b9a54eca2f4282712bc)
- doc: add reproducibility patch and README for gpqa (a2562f8d900a4598264cf979e7e1ca641d0bcc5e) Jun 10, 2024 23:55 add result for codeact 1.6 Xingyao Wang
17:47 add gpt-4-1106 results for codeact swe Xingyao Wang
16:57 Merge commit 'edc3858a6ea5d0c7317b630024203af60e146b52' Xingyao Wang
16:57 update all swebench lite Xingyao Wang
15:59 Update outputs/miniwob/README.md 15:57 Update outputs/webarena/README.md 15:56 Create README.md 15:56 Create README.md 14:55 remove extra merged file Xingyao Wang
14:54 add Mixtral Xingyao Wang
14:39 update results for CodeActSWEAgent Xingyao Wang
14:35 remove output merged for a new format Xingyao Wang
Jun 9, 2024 07:36 Delete outputs/webarena/BrowsingAgent/gpt-4o-2024-05-13_maxiter_15_N_v1.0/output.jsonl 07:36 Delete outputs/webarena/BrowsingAgent/gpt-3.5-turbo-0125_maxiter_15_N_v1.0/output.jsonl Jun 7, 2024 03:39 add webarena and miniwob results (#5 ) liboxuanhk +1: frankxu - Create webarena/readme.md (fd7dfce18fce04392b22dfab8db8bd31cfab7ae1)
- add od browsing agent results for webarena and miniwob++ (6cbc839d48eb66408424e41a58ee6e303ba52b29)
- remove unnecessary files (b7f0e396ea7e3775dd45b2a66867d9def545937e)
Co-authored-by: Frank Xu <frankxu@users.noreply.huggingface.co> 03:39 Add MINT results (#6 ) liboxuanhk +1: ryanhoangt - add all results for MINT (bb4e7dad562f3d68ff5e5ab9785b623c18a96464)
Co-authored-by: Ryan Tran <ryanhoangt@users.noreply.huggingface.co> Jun 6, 2024 05:13 agentbench (#3 ) - Add AgentBench evaluation results (b58d2c41cfd73f4c6ea5acf2899c5c3b0776a857)
- Update results (0e161f7c7c3ea71c78c45536285e33afca545d1c) 05:13 humanevalfix (#4 ) - Add humanevalfix (b1f62c0a7e73cb0af1a0a90752777f21480b7fb1) Jun 4, 2024 07:07 Create visualization for MINT benchmark & upload results (#2 ) xingyaoww +1: ryanhoangt - add some outputs (da7aaba4e08844c20e458ec7d554243dfc5349bf)
- add viz tab for mint (38a40d14b423e340d494308aa2871d4736c78053)
- add complete math output for gpt-4o (7d377c3c477760c429dfd7f5583f998a0edf0968)
- add complete mmlu output for gpt-4o (0948b4d436b173e9b5b165a8de4ee2099cd30f33)
- add complete humaneval output for gpt-4o (45710d94e2a58ead357ebdc378981aac09e042e4)
- add complete theoremqa output for gpt-4o (841a9486d33eece9d9cdb03bb15b02093656a1ad)
Co-authored-by: Ryan Tran <ryanhoangt@users.noreply.huggingface.co> May 30, 2024 10:56 update results Xingyao Wang
May 28, 2024 15:36 add results for deepseek chat v2 Xingyao Wang
15:36 add codeact swe agent Xingyao Wang
May 26, 2024 14:40 add gpt4o result for 1.5 Xingyao Wang
09:17 move data to swe_bench_lite Xingyao Wang
May 18, 2024 15:25 rename dir Xingyao Wang
15:15 add result for deepseek Xingyao Wang