Spaces:
Running
Running
Commit History
-
Mirror the agent rule, use the tag vocabulary, and gate both
Same change as in eval_cards_backend_pipeline (the tag table stays byte-identical): the frontend's `agent` rule had kept its trailing boundary, so eleven agent benchmarks tagged differently in the two repos; the three stem rules are now textually mirrored and the whole-word alternatives stay anchored. The one "security" entry, outside the 17-tag vocabulary, becomes safety; a vitest asserts every list in the table draws from EVALUATION_TAGS and pins the stem behaviour. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01C1uBAjR5FZuzD2B8ZfwwjP34b018c -
Tag the aiXamine leaderboards and fix the fallback stems that never matched
Mirror of the same change in eval_cards_backend_pipeline (the two tag files are kept byte-identical). Three fallback rules in benchmark-schema.ts ended in a word boundary right after a stem (hallucin, robust, agent), so "Hallucination", "Robustness" and "Agentic" never matched and those benchmarks tagged general. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01C1uBAjR5FZuzD2B8ZfwwjP1efee54 -
Tag AlpacaEval 1.0 and the LEXam benchmarks
Registered by eval-card-registry #55 and #54 (integration batch); keyed by display name here, they would otherwise fall through to `general`. Same change ships as evalcard_tags.json in eval_cards_backend_pipeline. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01C1uBAjR5FZuzD2B8ZfwwjPcc77dc0 -
Tag the GLUE, SuperGLUE, ANLI, HEAD-QA, LAMBADA and classic LM benchmarks
The registry (eval-card-registry#64 and its follow-up) adds the lm-evaluation-harness task families as standalone benchmarks grouped by family. categories.json is keyed by display name, so without entries every one of them fell through getBenchmarkTags to the regex fallback and tagged `general`, polluting the /evals category pills. Entries follow the existing neighbours: GLUE mirrors SuperGLUE (linguistic_core, general); NLI / paraphrase / sentiment tasks are linguistic_core; COPA and WSC are commonsense_reasoning like Winogrande; HEAD-QA and MedMCQA mirror MedQA (knowledge, natural_sciences). Variant display names such as "MNLI (mismatched)" and "HEAD-QA (English)" reach the base entry through the paren-suffix strip; "ANLI R1/2/3" get their own keys because the tight normaliser does not strip the round. The same table ships as evalcard_tags.json in eval_cards_backend_pipeline and is updated identically there. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: …cf3c3ab
-
Restructure model details + extend cleanHierarchy for split families and aggregator dedup
Adds a tri-state view selector (Source / Category / Overlaps) to the model detail page. The Overlaps view is a dedicated table with mean and 95% CI across cross-suite appearances; plotbox whiskers now come from the metric's paired stderr, not from cross-family spread. cleanHierarchy gains: split-family folding (Fibble Arena, AgentHarm, BFCL, CySE2, MATH-MC, MT-Bench, GSM-MC) into single benchmarks with splits; paren-suffix grouping for SWE-PolyBench / Multi-SWE-Bench language variants and HLE accuracy/calibration metrics; flatten-composites for RewardBench; score-equality-based aggregator dedup against comparison-index so llm-stats copies that literally match a canonical source's scores drop out at build time; leaderboard wrapper merge that re-routes eval ids into the canonical home; richness/subset/self-wrapper rules to drop redundant wrapper families (big-bench-hard, global-mmlu-lite, livebench, mmlu-pro). Stats are recomputed post-cleanup. Adds an HTML hierarchy explorer (scripts/…06313c1 -
Hotfix: categories
a80dd9f
-
Differentiate audience modes and tighten eval navigation
d8c2856
-
fix bugs
04b4cff -
chore: sync EEE pipeline output [2026-04-07 05:13 UTC]
GitHub Actionsddebd57
-
chore: sync EEE pipeline output [2026-04-06 05:29 UTC]
GitHub Actions969ee51
-
chore: sync EEE pipeline output [2026-04-05 05:17 UTC]
GitHub Actions8bb81ee
-
chore: sync EEE pipeline output [2026-04-04 04:53 UTC]
GitHub Actions04e134c
-
chore: sync EEE pipeline output [2026-04-03 05:09 UTC]
GitHub Actions85f9d10
-
chore: sync EEE pipeline output [2026-04-02 05:07 UTC]
GitHub Actions49596d9
-
chore: sync EEE pipeline output [2026-04-01 05:28 UTC]
GitHub Actionsd8be99e
-
chore: sync EEE pipeline output [2026-03-31 05:13 UTC]
GitHub Actionsabb1ee6
-
chore: sync EEE pipeline output [2026-03-30 05:29 UTC]
GitHub Actions523c970
-
chore: sync EEE pipeline output [2026-03-29 05:14 UTC]
GitHub Actionsb279bb2
-
chore: sync EEE pipeline output [2026-03-28 11:49 UTC]
GitHub Actionsd91b463 -
chore: sync EEE pipeline output [2026-03-28 11:37 UTC]
GitHub Actionsaa3daac -
chore: sync EEE pipeline output [2026-03-28 04:56 UTC]
GitHub Actions2edd871 -
flatten data
b827b8d -
chore: sync EEE pipeline output [2026-03-28 02:54 UTC]
GitHub Actions9167504
-
redesigned
3a12290 -
chore: sync EEE pipeline output [2026-03-27 05:11 UTC]
GitHub Actionsf727cf4