ounce100m-code / kernels /p6_harness_probe.py

Commit History

30 days ago

  1. p6_harness_probe v2: measure what a resolving lm-eval install moves, instead of assuming --no-deps is safe (it is not: sacrebleu import failure)

    Verified signature
    1a8377a
  2. p6_harness_probe: does lm-eval 0.4.13 resolve on transformers 5.0.0, and what do the 9 task configs declare (configs only, no eval data)

    Verified signature
    1742ac7