medrax2 / benchmarking

Commit History

  1. yes

    Junzhe Li
    dba3d2e

  1. Merge branch 'main' into tool-changes

    VictorLJZ
    e4e9fae
  2. fixing agent

    Junzhe Li
    fd330d9

  1. Set cuda:0 for medrax provider

    Adibvafa
    35e8f3b
  2. Merge branch 'main' into feature/benchmark

    VictorLJZ
    e6e3048
  3. fixes

    Junzhe Li
    d38594f

  1. revamped benchmarking suite

    Junzhe Li
    89321e2

  1. updated benchmarks

    Junzhe Li
    b93ad3f

  1. Fix merge conflicts

    Adibvafa
    128b355

  1. fixed rexvqa benchmark and added handling for image norm for tools

    victorli
    16278b5

  1. partially fixed rexvqa benchmark

    victorli
    c963ad3
  2. added concurrency to benchmarking

    victorli
    aa37a55
  3. Fix merge conflicts

    Adibvafa
    bc86327
  4. Setup MedRAX2 for test

    Adibvafa
    e116685

  1. fixed medgemma

    victorli
    7b3e756

  1. cleared merge issues

    victorli
    e97f266
  2. adding medgemma

    victorli
    1516987

  1. final updates

    044eaf7
  2. refactored tools

    25fe9b8

  1. added duckduckgo tool

    7608486

  1. add cuda

    Adibvafa
    6ee3108
  2. updates

    358df7a
  3. updates

    148dc3c
  4. updates

    d6cb1b4
  5. final fixed version

    c90e4b6
  6. changes

    6db0a72
  7. merge

    719e93e
  8. modified agent setup

    05f20bf

  1. Chagne formatting to use boxed

    Adibvafa
    36f77f2
  2. Prep for actual benchmarking

    Adibvafa
    7f4d4c2
  3. fixed medrax provider

    e25f680
  4. updates

    587ddab
  5. Merge branch 'feature/benchmark' into victor

    4216843

  1. Seed random shuffle

    Adibvafa
    6bbb74f
  2. Enable shuffling for benchmark

    Adibvafa
    ddb8bad

  1. Merge branch 'feature/benchmark' into victor

    35025a2
  2. updates

    d01acb6
  3. refactored rexvqa benchmark

    eaff77c
  4. Fix prompt load

    Adibvafa
    a7d0aad
  5. Supoort individual logging

    Adibvafa
    5084d75
  6. removed anthropic provider

    f350e79

  1. added anthropic provider

    b0f54ed
  2. addressed PR comments

    9c54b1c
  3. added openrouter provider

    f60c51c
  4. adding this just in case

    e040fb2
  5. rexvqa now works

    c7b65ec

  1. updates

    d07a267

  1. added chestagentbench

    2b26ed4
  2. updates

    e08f161
  3. simplifying evaluations

    a8f2960