Spaces:
Sleeping
Sleeping
Commit History
-
Refactor to align on benchmark hierarchy
2ed4959
-
Update with datafix v2
11542d9
-
Tighten eval cards UI and clean up stale local data
UI changes - Replace the stand-alone reproducibility/per-row signal indicators with a single benchmark-level interpretive-signals strip (paper §4.2.1). Strip is rendered compactly inside the technical-details accordion, sized to match the Card Quality Notes box; large 4-tile layout was doing too much. Per-record reproducibility/provenance display in leaderboard rows is removed since signals are corpus/eval-level. - Theme the param range picker against the design system (square thumbs, hairline rail, mono ticks). Three variants (default / inline / promo). Visibility of the picker is gated on whether any model in the leaderboard has a detectable parameter count, with an explicit "Show models without known size" toggle when present. - Eval list: drop the near-empty Suites/Slices/Metrics/Organisation columns, drop the always-grey category dot, expose a one-line family description sourced from the navigation target (no leaf borrowing), and add a category pill selecto…32864b0
-
Separate policy and researcher views
- Foundations: glossary + Term + ModeSwitch helpers - Policy: plain-language summary, scope chips, provenance row, collapsible subtasks, technical details pushed into expander - Researcher: per-row Reproducibility card with adaptive compact mode for limited-disclosure rows; agent setup group for agentic evals; lazy-fetched generation_config + score_details from model files - Replace boilerplate IBM risk field with curated known-issues registry - Apples-to-apples banner above leaderboards, anchored to Comparability panel - Methodology split: surface task setup, scoring, validation - Compact row-signals indicator replacing repetitive coloured badges - Cleaner divergence chips in Comparability panel; full-width when only one divergence type fires - Flag-this-score button that links to the dataset record on HF and pre-fills a discussion title plus copyable context - Defensive guard so an embedded ancestor card no longer leaks its text onto a leaf-benchmark page9b4cdbb
-
Add interpretive signals, corpus dashboard, and slice browser
Surfaces reproducibility, reporting completeness, provenance, and comparability signals from the backend across eval detail, model compare, eval list cards, and a new /corpus dashboard. Adapts to the upstream 2-level hierarchy (family → leaf), caps the leaderboard at 24 default columns and replaces the slice tabs with a search dialog when a benchmark has more than 5 slices. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>bca888a
-
Aggregate setup aliases and clarify benchmark variants
dd0b4fc
-
Add per-benchmark comparison histograms on model detail
Rewires the model detail page to render one histogram per (benchmark, metric) backed by the new comparison-index.json artifact. Each card groups peers from the same family (Fibble1…Fibble5 under Fibble Arena, RewardBench 2's components under one card), shows metric tabs with backend-sorted order, exposes submission-axis metadata (harness / variant / rerun) on multi-submission peers, and surfaces secondary metrics or per-split subtasks in an accordion below the chart. Ranks are read directly from comparison-index by_model, retiring the peer-ranks round-trip on this surface. Also adds `/api/eval-detail` for the deep-dive modal and wires `comparison-index.json` into the build-time cache script. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>415ac43
-
Refresh eval cards UI and backend data flow
c1f2130
-
fix bugs
04b4cff
-
ux changes
5f59721
-
feat: refine model and benchmark exploration
03e2430
-
redesigned
3a12290
-
fix data
Avijit Ghoshddfc163 -
Refactor: Update benchmarks with realistic data, fix UI stats, and improve About page
Avijit Ghosh2554366 -
new ux
Avijit Ghosh6978d97