EvalEvalBot commited on
Commit
013c1cd
·
verified ·
1 Parent(s): 993b525

Sync from evaleval/eval-cards via hub-sync

Browse files
.claude/skills/adapt DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/adapt
 
 
.claude/skills/animate DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/animate
 
 
.claude/skills/arrange DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/arrange
 
 
.claude/skills/audit DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/audit
 
 
.claude/skills/bolder DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/bolder
 
 
.claude/skills/clarify DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/clarify
 
 
.claude/skills/colorize DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/colorize
 
 
.claude/skills/critique DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/critique
 
 
.claude/skills/delight DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/delight
 
 
.claude/skills/distill DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/distill
 
 
.claude/skills/extract DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/extract
 
 
.claude/skills/frontend-design DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/frontend-design
 
 
.claude/skills/harden DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/harden
 
 
.claude/skills/normalize DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/normalize
 
 
.claude/skills/onboard DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/onboard
 
 
.claude/skills/optimize DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/optimize
 
 
.claude/skills/overdrive DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/overdrive
 
 
.claude/skills/polish DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/polish
 
 
.claude/skills/quieter DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/quieter
 
 
.claude/skills/teach-impeccable DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/teach-impeccable
 
 
.claude/skills/typeset DELETED
@@ -1 +0,0 @@
1
- ../../.agents/skills/typeset
 
 
.github/copilot-instructions.md DELETED
@@ -1,42 +0,0 @@
1
- ## Design Context
2
-
3
- ### Users
4
- The interface serves two primary audiences: evaluation researchers and policymakers. Researchers use it to compare evaluations, understand methodological differences, and inspect evidence quality. Policymakers use it to understand what has been evaluated, how much supporting evidence exists, and which models have broader or thinner reporting coverage.
5
-
6
- ### Brand Personality
7
- The product should feel editorial, premium, and vivid. It should communicate credibility and seriousness without becoming visually sterile. The emotional goal is confidence and clarity with a sense of polish, not hype.
8
-
9
- ### Aesthetic Direction
10
- The interface should feel like a refined research publication with selective bursts of color. It should work in both light and dark mode. The visual direction should avoid oversized hero metrics, noisy card interiors, and overcrowded dashboards. Information density should be controlled carefully because the homepage presents many cards at once.
11
-
12
- ### Design Principles
13
- 1. Prefer compact, layered summaries over large isolated stat blocks.
14
- 2. Use color intentionally to create scanability and editorial hierarchy, not decoration.
15
- 3. Support both research and policy reading modes by shifting emphasis rather than duplicating content.
16
- 4. Keep card typography restrained so multiple cards remain legible in a grid.
17
- 5. Make evidence, breadth, and context feel trustworthy and easy to compare at a glance.
18
-
19
- ### Audience Surface Rules
20
-
21
- #### Eval Researcher Mode
22
- - Lead with methodology, reproducibility, and comparability.
23
- - Surface inference settings, eval library/version, benchmark setup, generation config, and source relationships prominently.
24
- - Preserve technical terminology when it helps precise comparison.
25
- - Prefer tables, filters, exports, score distributions, config diffs, and sample-level inspection.
26
- - Highlight missing reproducibility fields such as null generation configs as methodological warnings.
27
- - Make apples-to-apples comparison affordances primary rather than secondary.
28
-
29
- #### AI Policy Mode
30
- - Lead with plain-language interpretation, governance relevance, and source accountability.
31
- - Translate schema fields into reader-facing meaning rather than exposing raw jargon by default.
32
- - Surface evaluator independence, reporting organization, test date, benchmark purpose, caveats, and comparability status prominently.
33
- - Prefer narrative summaries, callouts, badges, and guided explanations over dense technical controls.
34
- - Make limitations and confidence caveats highly visible to reduce score over-interpretation.
35
- - Keep technical configuration available, but subordinate it behind clearer public-interest framing.
36
-
37
- #### Field Translation Guidance
38
- - `evaluator_relationship: third_party` should map to an independent verification signal in policy mode.
39
- - Missing `generation_config` should be treated as a reproducibility gap, not merely an absent field.
40
- - `retrieved_timestamp` should be surfaced as the date tested because timing matters for governance review.
41
- - Large size/parameter differences should be surfaced as comparability caveats in policy mode.
42
- - Instance-level or sample-level data should be a primary exploration tool in researcher mode and a selective illustration tool in policy mode.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
.gitignore DELETED
@@ -1,60 +0,0 @@
1
- # See https://help.github.com/articles/ignoring-files/ for more about ignoring files.
2
-
3
- *.DS_Store
4
-
5
- # dependencies
6
- /node_modules
7
-
8
- # next.js
9
- /.next/
10
- /out/
11
-
12
- # production
13
- /build
14
- /out
15
-
16
- # debug
17
- npm-debug.log*
18
- yarn-debug.log*
19
- yarn-error.log*
20
- .pnpm-debug.log*
21
-
22
- # env files
23
- .env*
24
-
25
- # vercel
26
- .vercel
27
-
28
- # typescript
29
- *.tsbuildinfo
30
- next-env.d.ts
31
- .cache/
32
- pipeline_revised.py
33
- .local-data/
34
-
35
- # Local data dumps. The runtime reads from .cache/hf-data/duckdb parquets;
36
- # anything under /data/ is leftover from offline scripts and should not
37
- # ship in git. Survey schema and the curated benchmark categories are
38
- # loaded statically at build time, so they do ship.
39
- /data/*
40
- !/data/survey/
41
- /data/survey/*
42
- !/data/survey/eval-schema-fields.json
43
- !/data/benchmarks/
44
- /data/benchmarks/*
45
- !/data/benchmarks/categories.json
46
- mock_design/
47
- shoot.mjs
48
- whisker-render.mjs
49
- output/
50
- public/peer-ranks.json
51
- **/* (1).tsx
52
-
53
- # private working notes / design specs / migration plans — not for publishing
54
- notes/
55
- docs/INTERPRETIVE_SIGNALS.md
56
-
57
- # Playwright e2e output (tests/e2e via @playwright/test)
58
- test-results/
59
- playwright-report/
60
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
README.md CHANGED
@@ -19,7 +19,7 @@ tags:
19
  A Next.js application for **viewing** AI evaluations. It is the reader frontend of the
20
  Eval Cards platform: it does not author or store evaluation data itself — it renders a
21
  materialised warehouse **view layer** produced upstream by the `eval_card_backend`
22
- pipeline, and deploys to the Hugging Face Space `evaleval/eval-cards` (Docker runtime).
23
 
24
  ## Project Goals
25
 
@@ -101,8 +101,27 @@ Visit `http://localhost:3000` to verify.
101
 
102
  ### Deploy to Hugging Face Spaces
103
 
104
- 1. Create a new Space at https://huggingface.co/new-space and choose **Docker** as the runtime.
105
- 2. Push this repository to the Space Git (or upload files through the UI). The Space builds the Docker image using the included `Dockerfile` and serves the app on port 3000.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
106
 
107
  Notes:
108
  - If your build needs native dependencies (e.g. `sharp`), the Docker image may require extra apt packages; update the Dockerfile accordingly.
 
19
  A Next.js application for **viewing** AI evaluations. It is the reader frontend of the
20
  Eval Cards platform: it does not author or store evaluation data itself — it renders a
21
  materialised warehouse **view layer** produced upstream by the `eval_card_backend`
22
+ pipeline, and deploys to the Hugging Face Space `evaleval/general-eval-card` (Docker runtime).
23
 
24
  ## Project Goals
25
 
 
101
 
102
  ### Deploy to Hugging Face Spaces
103
 
104
+ **GitHub is the source of truth.** This repo lives at
105
+ [`evaleval/eval-cards`](https://github.com/evaleval/eval-cards); the Space
106
+ [`evaleval/general-eval-card`](https://huggingface.co/spaces/evaleval/general-eval-card)
107
+ is a mirror of it. Every push to `main` runs
108
+ [`.github/workflows/sync-to-hf-space.yml`](.github/workflows/sync-to-hf-space.yml), which
109
+ uses [`huggingface/hub-sync`](https://github.com/huggingface/hub-sync) to upload the tree
110
+ to the Space; the Space then rebuilds the Docker image and serves the app on port 3000.
111
+ The workflow can also be run by hand from the Actions tab (`workflow_dispatch`).
112
+
113
+ Consequences worth knowing:
114
+
115
+ - **Do not commit directly to the Space.** The sync runs with `delete_removed: true`, so
116
+ anything on the Hub that is not in the GitHub tree is removed on the next push. Make
117
+ changes here and let them flow downstream.
118
+ - The sync needs an `HF_TOKEN` repository secret — a Hugging Face token with **write**
119
+ access to the `evaleval` org.
120
+ - `.github/` and root `.git*` files (including `.gitattributes`) are never uploaded, so
121
+ the Space keeps its own copy of those.
122
+ - Binary assets under `public/` are tracked with Git LFS, which is why the workflow checks
123
+ out with `lfs: true`. Without it the Space would receive LFS pointer text instead of the
124
+ actual images.
125
 
126
  Notes:
127
  - If your build needs native dependencies (e.g. `sharp`), the Docker image may require extra apt packages; update the Dockerfile accordingly.