Spaces:
Running
Running
Sync from evaleval/eval-cards via hub-sync
Browse files- .claude/skills/adapt +0 -1
- .claude/skills/animate +0 -1
- .claude/skills/arrange +0 -1
- .claude/skills/audit +0 -1
- .claude/skills/bolder +0 -1
- .claude/skills/clarify +0 -1
- .claude/skills/colorize +0 -1
- .claude/skills/critique +0 -1
- .claude/skills/delight +0 -1
- .claude/skills/distill +0 -1
- .claude/skills/extract +0 -1
- .claude/skills/frontend-design +0 -1
- .claude/skills/harden +0 -1
- .claude/skills/normalize +0 -1
- .claude/skills/onboard +0 -1
- .claude/skills/optimize +0 -1
- .claude/skills/overdrive +0 -1
- .claude/skills/polish +0 -1
- .claude/skills/quieter +0 -1
- .claude/skills/teach-impeccable +0 -1
- .claude/skills/typeset +0 -1
- .github/copilot-instructions.md +0 -42
- .gitignore +0 -60
- README.md +22 -3
.claude/skills/adapt
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/adapt
|
|
|
|
|
|
.claude/skills/animate
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/animate
|
|
|
|
|
|
.claude/skills/arrange
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/arrange
|
|
|
|
|
|
.claude/skills/audit
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/audit
|
|
|
|
|
|
.claude/skills/bolder
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/bolder
|
|
|
|
|
|
.claude/skills/clarify
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/clarify
|
|
|
|
|
|
.claude/skills/colorize
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/colorize
|
|
|
|
|
|
.claude/skills/critique
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/critique
|
|
|
|
|
|
.claude/skills/delight
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/delight
|
|
|
|
|
|
.claude/skills/distill
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/distill
|
|
|
|
|
|
.claude/skills/extract
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/extract
|
|
|
|
|
|
.claude/skills/frontend-design
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/frontend-design
|
|
|
|
|
|
.claude/skills/harden
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/harden
|
|
|
|
|
|
.claude/skills/normalize
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/normalize
|
|
|
|
|
|
.claude/skills/onboard
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/onboard
|
|
|
|
|
|
.claude/skills/optimize
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/optimize
|
|
|
|
|
|
.claude/skills/overdrive
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/overdrive
|
|
|
|
|
|
.claude/skills/polish
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/polish
|
|
|
|
|
|
.claude/skills/quieter
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/quieter
|
|
|
|
|
|
.claude/skills/teach-impeccable
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/teach-impeccable
|
|
|
|
|
|
.claude/skills/typeset
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
../../.agents/skills/typeset
|
|
|
|
|
|
.github/copilot-instructions.md
DELETED
|
@@ -1,42 +0,0 @@
|
|
| 1 |
-
## Design Context
|
| 2 |
-
|
| 3 |
-
### Users
|
| 4 |
-
The interface serves two primary audiences: evaluation researchers and policymakers. Researchers use it to compare evaluations, understand methodological differences, and inspect evidence quality. Policymakers use it to understand what has been evaluated, how much supporting evidence exists, and which models have broader or thinner reporting coverage.
|
| 5 |
-
|
| 6 |
-
### Brand Personality
|
| 7 |
-
The product should feel editorial, premium, and vivid. It should communicate credibility and seriousness without becoming visually sterile. The emotional goal is confidence and clarity with a sense of polish, not hype.
|
| 8 |
-
|
| 9 |
-
### Aesthetic Direction
|
| 10 |
-
The interface should feel like a refined research publication with selective bursts of color. It should work in both light and dark mode. The visual direction should avoid oversized hero metrics, noisy card interiors, and overcrowded dashboards. Information density should be controlled carefully because the homepage presents many cards at once.
|
| 11 |
-
|
| 12 |
-
### Design Principles
|
| 13 |
-
1. Prefer compact, layered summaries over large isolated stat blocks.
|
| 14 |
-
2. Use color intentionally to create scanability and editorial hierarchy, not decoration.
|
| 15 |
-
3. Support both research and policy reading modes by shifting emphasis rather than duplicating content.
|
| 16 |
-
4. Keep card typography restrained so multiple cards remain legible in a grid.
|
| 17 |
-
5. Make evidence, breadth, and context feel trustworthy and easy to compare at a glance.
|
| 18 |
-
|
| 19 |
-
### Audience Surface Rules
|
| 20 |
-
|
| 21 |
-
#### Eval Researcher Mode
|
| 22 |
-
- Lead with methodology, reproducibility, and comparability.
|
| 23 |
-
- Surface inference settings, eval library/version, benchmark setup, generation config, and source relationships prominently.
|
| 24 |
-
- Preserve technical terminology when it helps precise comparison.
|
| 25 |
-
- Prefer tables, filters, exports, score distributions, config diffs, and sample-level inspection.
|
| 26 |
-
- Highlight missing reproducibility fields such as null generation configs as methodological warnings.
|
| 27 |
-
- Make apples-to-apples comparison affordances primary rather than secondary.
|
| 28 |
-
|
| 29 |
-
#### AI Policy Mode
|
| 30 |
-
- Lead with plain-language interpretation, governance relevance, and source accountability.
|
| 31 |
-
- Translate schema fields into reader-facing meaning rather than exposing raw jargon by default.
|
| 32 |
-
- Surface evaluator independence, reporting organization, test date, benchmark purpose, caveats, and comparability status prominently.
|
| 33 |
-
- Prefer narrative summaries, callouts, badges, and guided explanations over dense technical controls.
|
| 34 |
-
- Make limitations and confidence caveats highly visible to reduce score over-interpretation.
|
| 35 |
-
- Keep technical configuration available, but subordinate it behind clearer public-interest framing.
|
| 36 |
-
|
| 37 |
-
#### Field Translation Guidance
|
| 38 |
-
- `evaluator_relationship: third_party` should map to an independent verification signal in policy mode.
|
| 39 |
-
- Missing `generation_config` should be treated as a reproducibility gap, not merely an absent field.
|
| 40 |
-
- `retrieved_timestamp` should be surfaced as the date tested because timing matters for governance review.
|
| 41 |
-
- Large size/parameter differences should be surfaced as comparability caveats in policy mode.
|
| 42 |
-
- Instance-level or sample-level data should be a primary exploration tool in researcher mode and a selective illustration tool in policy mode.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.gitignore
DELETED
|
@@ -1,60 +0,0 @@
|
|
| 1 |
-
# See https://help.github.com/articles/ignoring-files/ for more about ignoring files.
|
| 2 |
-
|
| 3 |
-
*.DS_Store
|
| 4 |
-
|
| 5 |
-
# dependencies
|
| 6 |
-
/node_modules
|
| 7 |
-
|
| 8 |
-
# next.js
|
| 9 |
-
/.next/
|
| 10 |
-
/out/
|
| 11 |
-
|
| 12 |
-
# production
|
| 13 |
-
/build
|
| 14 |
-
/out
|
| 15 |
-
|
| 16 |
-
# debug
|
| 17 |
-
npm-debug.log*
|
| 18 |
-
yarn-debug.log*
|
| 19 |
-
yarn-error.log*
|
| 20 |
-
.pnpm-debug.log*
|
| 21 |
-
|
| 22 |
-
# env files
|
| 23 |
-
.env*
|
| 24 |
-
|
| 25 |
-
# vercel
|
| 26 |
-
.vercel
|
| 27 |
-
|
| 28 |
-
# typescript
|
| 29 |
-
*.tsbuildinfo
|
| 30 |
-
next-env.d.ts
|
| 31 |
-
.cache/
|
| 32 |
-
pipeline_revised.py
|
| 33 |
-
.local-data/
|
| 34 |
-
|
| 35 |
-
# Local data dumps. The runtime reads from .cache/hf-data/duckdb parquets;
|
| 36 |
-
# anything under /data/ is leftover from offline scripts and should not
|
| 37 |
-
# ship in git. Survey schema and the curated benchmark categories are
|
| 38 |
-
# loaded statically at build time, so they do ship.
|
| 39 |
-
/data/*
|
| 40 |
-
!/data/survey/
|
| 41 |
-
/data/survey/*
|
| 42 |
-
!/data/survey/eval-schema-fields.json
|
| 43 |
-
!/data/benchmarks/
|
| 44 |
-
/data/benchmarks/*
|
| 45 |
-
!/data/benchmarks/categories.json
|
| 46 |
-
mock_design/
|
| 47 |
-
shoot.mjs
|
| 48 |
-
whisker-render.mjs
|
| 49 |
-
output/
|
| 50 |
-
public/peer-ranks.json
|
| 51 |
-
**/* (1).tsx
|
| 52 |
-
|
| 53 |
-
# private working notes / design specs / migration plans — not for publishing
|
| 54 |
-
notes/
|
| 55 |
-
docs/INTERPRETIVE_SIGNALS.md
|
| 56 |
-
|
| 57 |
-
# Playwright e2e output (tests/e2e via @playwright/test)
|
| 58 |
-
test-results/
|
| 59 |
-
playwright-report/
|
| 60 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
README.md
CHANGED
|
@@ -19,7 +19,7 @@ tags:
|
|
| 19 |
A Next.js application for **viewing** AI evaluations. It is the reader frontend of the
|
| 20 |
Eval Cards platform: it does not author or store evaluation data itself — it renders a
|
| 21 |
materialised warehouse **view layer** produced upstream by the `eval_card_backend`
|
| 22 |
-
pipeline, and deploys to the Hugging Face Space `evaleval/eval-
|
| 23 |
|
| 24 |
## Project Goals
|
| 25 |
|
|
@@ -101,8 +101,27 @@ Visit `http://localhost:3000` to verify.
|
|
| 101 |
|
| 102 |
### Deploy to Hugging Face Spaces
|
| 103 |
|
| 104 |
-
|
| 105 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
|
| 107 |
Notes:
|
| 108 |
- If your build needs native dependencies (e.g. `sharp`), the Docker image may require extra apt packages; update the Dockerfile accordingly.
|
|
|
|
| 19 |
A Next.js application for **viewing** AI evaluations. It is the reader frontend of the
|
| 20 |
Eval Cards platform: it does not author or store evaluation data itself — it renders a
|
| 21 |
materialised warehouse **view layer** produced upstream by the `eval_card_backend`
|
| 22 |
+
pipeline, and deploys to the Hugging Face Space `evaleval/general-eval-card` (Docker runtime).
|
| 23 |
|
| 24 |
## Project Goals
|
| 25 |
|
|
|
|
| 101 |
|
| 102 |
### Deploy to Hugging Face Spaces
|
| 103 |
|
| 104 |
+
**GitHub is the source of truth.** This repo lives at
|
| 105 |
+
[`evaleval/eval-cards`](https://github.com/evaleval/eval-cards); the Space
|
| 106 |
+
[`evaleval/general-eval-card`](https://huggingface.co/spaces/evaleval/general-eval-card)
|
| 107 |
+
is a mirror of it. Every push to `main` runs
|
| 108 |
+
[`.github/workflows/sync-to-hf-space.yml`](.github/workflows/sync-to-hf-space.yml), which
|
| 109 |
+
uses [`huggingface/hub-sync`](https://github.com/huggingface/hub-sync) to upload the tree
|
| 110 |
+
to the Space; the Space then rebuilds the Docker image and serves the app on port 3000.
|
| 111 |
+
The workflow can also be run by hand from the Actions tab (`workflow_dispatch`).
|
| 112 |
+
|
| 113 |
+
Consequences worth knowing:
|
| 114 |
+
|
| 115 |
+
- **Do not commit directly to the Space.** The sync runs with `delete_removed: true`, so
|
| 116 |
+
anything on the Hub that is not in the GitHub tree is removed on the next push. Make
|
| 117 |
+
changes here and let them flow downstream.
|
| 118 |
+
- The sync needs an `HF_TOKEN` repository secret — a Hugging Face token with **write**
|
| 119 |
+
access to the `evaleval` org.
|
| 120 |
+
- `.github/` and root `.git*` files (including `.gitattributes`) are never uploaded, so
|
| 121 |
+
the Space keeps its own copy of those.
|
| 122 |
+
- Binary assets under `public/` are tracked with Git LFS, which is why the workflow checks
|
| 123 |
+
out with `lfs: true`. Without it the Space would receive LFS pointer text instead of the
|
| 124 |
+
actual images.
|
| 125 |
|
| 126 |
Notes:
|
| 127 |
- If your build needs native dependencies (e.g. `sharp`), the Docker image may require extra apt packages; update the Dockerfile accordingly.
|