Spaces:
Sleeping
Sleeping
Commit History
-
Swap backend data (#3)
- Integrate with test backend data (7635aee64606c5b9138e680b833ca1383b570887) - Drop input_modalities/output_modalities from MODEL_CARD_COLUMNS (bfce8f214eed3054b820176601eaa0a23e31bee7) - Merge remote-tracking branch 'origin/main' into feat/use-new-backend-data (25ba6d010ff24b92f252f8fe11a6624f68aa6690) - Use model_key as the addressable identifier and wire comparison-index sidecar (0e529dce5eb243708739730f1fcec00d27202d71) Co-authored-by: Jenny Chim <j-chim@users.noreply.huggingface.co>fe99ffa
-
Restore DuckDB-aware build cache logic
The rebase took origin/main wholesale for cache-hf-data.mjs to preserve the new corpus-aggregates.json fetch. That dropped four pieces of the DuckDB build path that the production HF Space deploy needs: - isDuckDBLean mode + ESSENTIAL/JSON_FALLBACK split (skips ~2.7 GB of JSON snapshots that OOM the Space) - HF_DATASET_REPO env var override (so the Dockerfile ARG reaches the cache step instead of being silently ignored) - duckdb/ in CACHE_DIRECTORIES (else the parquet that lib/duckdb-data.ts reads is never copied → static prerender fails) - Binary-safe download via Buffer.from(arrayBuffer()) instead of response.text() (text-mode would corrupt parquet) - HF_TOKEN auth header for private/gated dataset access Re-applies 14c3a2d's intent and adds corpus-aggregates.json to the essential set (essential because the corpus dashboard depends on it in both modes; optional because the prod dataset may not have it populated yet). Co-Authored-By: Claude Opus 4.7 (1M con…154e1d8
-
Add interpretive signals, corpus dashboard, and slice browser
Surfaces reproducibility, reporting completeness, provenance, and comparability signals from the backend across eval detail, model compare, eval list cards, and a new /corpus dashboard. Adapts to the upstream 2-level hierarchy (family → leaf), caps the leaderboard at 24 default columns and replaces the slice tabs with a search dialog when a benchmark has more than 5 slices. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>bca888a
-
Aggregate setup aliases and clarify benchmark variants
dd0b4fc -
Improve eval/model UX, lite data paths, and leaderboard clarity
436ada0
-
Add per-benchmark comparison histograms on model detail
Rewires the model detail page to render one histogram per (benchmark, metric) backed by the new comparison-index.json artifact. Each card groups peers from the same family (Fibble1…Fibble5 under Fibble Arena, RewardBench 2's components under one card), shows metric tabs with backend-sorted order, exposes submission-axis metadata (harness / variant / rerun) on multi-submission peers, and surfaces secondary metrics or per-split subtasks in an accordion below the chart. Ranks are read directly from comparison-index by_model, retiring the peer-ranks round-trip on this surface. Also adds `/api/eval-detail` for the deep-dive modal and wires `comparison-index.json` into the build-time cache script. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>415ac43 -
Harden aggregate evals and cache refresh
9d14977
-
Refresh eval cards UI and backend data flow
c1f2130