Spaces:
Running
Running
Commit History
-
Update to uniform US spelling
2fd6a71
-
Add dynamic thumbnails for orgs
e068beb
-
Untrack accidentally-committed noise files; gitignore the patterns
The previous commit (b6dab21) pulled in several files that should not be tracked: - "(1).tsx" — Finder duplicates of route files - output/hierarchy_explorer.html — local probe output - public/peer-ranks.json — local-generated cache (~370k lines) - app/embed/eval/distribution/[...id]/page.tsx — orphan route Remove from the index and extend .gitignore so they can't sneak back through a `git add -A` or accidental wildcard. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>445ce35 -
view-data: paranoid CAST every output column to a primitive type
The previous patch left simple scalars (VARCHAR / BOOLEAN / DOUBLE / INTEGER) untouched, on the assumption the binding handles those natively. The deployed log still surfaces "Invalid Error: don't know what type:" on the new explicit-column SELECT, which means whatever the binding is choking on is reachable even without r.* expansion and even with every nested type wrapped. The only thing left to vary is whether the binding ever sees the parquet's native logical types at all. Force every output column through `CAST(... AS <primitive>)`. The binding now only ever sees VARCHAR / BOOLEAN / INTEGER / DOUBLE in the result schema regardless of what type the underlying parquet column declared. Local prod build keeps returning 200 on /api/model-summary with model_info correctly nested. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>b6dab21 -
Embeds: histogram route, leaderboard slices + sort, brand mark; cross-source row dedup
Embed routes - New /embed/eval/histogram/<evalId>?model=<routeId> renders a single model/benchmark plotbox inside <BenchmarkDetail> via a new embedSurface="histogram" + embedTargetEvalId; the on-page split picker, view selector, peer rank, cross-family whisker and setup notes all flow through unchanged. The plotbox EmbedButton points at this route with label "Histogram". - Leaderboard embed: SPLIT dropdown for subtask-sliced evals (Global MMLU style), click-to-sort column headers with direction toggle, and getMetricChipLabel fallback so cells stop collapsing to "Score" when display_name is generic. - Frontier embed: same slice picker, locked to frontier view (showViewToggle=false), shared metric-label fallback. - Embed layout: small EvalEval logo + text in the top-left of every embed, linking to evalcards.evalevalai.com. Cross-source row dedup - New dedupeLeaderboardRowsByModelIdentity in lib/eval-processing.ts collapses two-source duplicates (e.g. one row develo…7a54021
-
Cross-source dedup, plotbox polish, pretty URLs, eval page fallbacks
Model page (benchmark-detail.tsx) — cross-source grouping rework: - Category-mode tiles dedupe per benchmark canonical (8x MMLU-Pro across helm/vals-ai/openeval/… → 1 tile + cross-family whisker overlay), with an "N sources" badge. - Fixed benchmarkIndexLookup to prefer benchmark canonicals over umbrella entries (suite/aggregator) when building eval_summary_id → canonical_key. Without that, ids like artificial-analysis-llms/mmlu-pro mapped to "artificial analysis" instead of "mmlu-pro" and dedup leaked. - Aggregator-only score dedup: byte-equal scores from llm-stats are dropped (republished canonical numbers) but two independent evaluators arriving at the same number both stay — confirming signal, not duplicate data. Plus an eval_summary_id dedup before score dedup so the same observation listed under two family_keys in benchmark_index doesn't double-count. - Multi-category bucketing: a benchmark with curated tags ["general", "re…0b45710