File size: 2,922 Bytes
6cc401b d17a72b 54baa33 6cc401b 54baa33 6cc401b 2b7ec11 54baa33 e69520f 2b7ec11 54baa33 2b7ec11 54baa33 2b7ec11 54baa33 2b7ec11 54baa33 2b7ec11 e69520f 2b7ec11 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 | ---
title: Cultural Riddles
emoji: 🧩
colorFrom: indigo
colorTo: blue
sdk: static
app_file: index.html
pinned: false
---
# Cultural Riddles: results dashboard
Paper: [CulturalRiddles: A Multicultural Benchmark of Riddles](https://arxiv.org/abs/2610.29968)
The dashboard is one static HTML page with Plotly loaded from a CDN. It shows
which model solved which riddle, the leaderboard with each model's spread across
communities, a model-by-community grid, a page for each community, geography
and language resources, how answers were scored, the controlled comparisons,
and how the benchmark is built. Published pages need an internet connection for Plotly, but no
Python runtime or application server. The front matter at the top of this file
configures a static Hugging Face Space when you upload this README and the built
page together.
## Data and build contract
Run commands from the repository root, using the root uv environment:
```bash
uv run python -m analysis.export_dashboard
uv run python -m dashboard.build_static
```
`analysis.export_dashboard` uses the shared analysis loaders and table functions,
canonical inputs under `data/canonical/`, and topic summaries under
`data/derived/`. It writes aggregates only to
`data/derived/dashboard/dashboard_data.json`: no answers, riddle text, individual
survey responses, or contributor identities.
The export also carries fitted local-term odds ratios and confidence intervals
from the released riddle-feature summary. Translation comparison model labels
come from the shared English-condition configuration map; the high-resource
comparison is recomputed for those same configurations. These headline values
are rendered from JSON, not fixed in the page template.
The riddle matrix records, for riddles that every model has a score for, which
models solved each one, as one bit per riddle and model. It carries each
column's community and solve count, not riddle IDs or text.
`dashboard.compute` loads that JSON and validates relationships between the
leaderboard, score distributions, model-community grid, per-community topics,
riddle matrix, coverage, error types, topics, and paired comparisons. It does not pin historical numerical results.
`dashboard.build_static` uses only that JSON and Python's standard library; it
does not import the analysis pipeline or read its source tables. It embeds the
validated aggregates in `template.html` (layout, styles and chart code) and
writes the ignored build artifact `dashboard/index.html`.
You can rebuild from an existing JSON export without regenerating analysis.
To run the data consistency checks without writing HTML:
```bash
uv run python -m dashboard.compute
```
For prerequisites, deployment, and browser smoke checks, see
[Rebuild and publish the dashboard](https://github.com/Cohere-Labs-Community/CulturalRiddles/blob/main/dashboard/DEPLOY.md). There is no nested Python project
or lockfile.
|