Spaces:
Running
Running
| title: Agent Memory Bench | |
| emoji: 🧠 | |
| colorFrom: indigo | |
| colorTo: gray | |
| sdk: static | |
| app_file: index.html | |
| pinned: false | |
| license: apache-2.0 | |
| short_description: Execution-graded benchmark of memory for coding agents | |
| tags: | |
| - leaderboard | |
| - agents | |
| - agent-memory | |
| - benchmark | |
| # agent-memory-bench | |
| A preregistered, execution-graded benchmark of **memory layers for coding agents**, measured by | |
| task success on real coding tasks executed by Claude Code. Tests pass or they do not; no LLM judge | |
| appears anywhere in the primary endpoint. | |
| - Canonical site: **https://giulioder.github.io/agent-memory-bench/** | |
| - Repository: **https://github.com/GiulioDER/agent-memory-bench** | |
| - Corpus: **https://huggingface.co/datasets/Gde05/agent-memory-bench-corpus** | |
| This Space is a mirror. The canonical site is the GitHub Pages deployment above, and the two are | |
| built from the same `site/` directory, so if they ever disagree the Pages copy is the one to | |
| trust. | |
| ## The board is empty on purpose | |
| `site/data/leaderboard.config.json` carries `"official_run": null`, and a number reaches the page | |
| only through a run's `leaderboard_summary.json`. No multi-product run has happened, so there is | |
| nothing to show and the page says so rather than filling itself with pilots. | |
| Two rules the page enforces in code rather than promising in prose: | |
| - **No third-party product is named before it has been told.** A vendor is invited to review its | |
| own adapter and frozen configuration before any measured run. Undisclosed arms appear as | |
| `product_a`, `product_b` and so on, with the integration type withheld as well, because "SaaS | |
| API" against a short field of candidates is most of an identification on its own. | |
| - **No multi-product ranking ships while the write path is unmeasured**, or it ships titled for | |
| what it actually measured: `Retrieval over a bulk-ingested corpus`. The corpus is bulk ingested | |
| once before the grid and never written to again, so a ranking built from it ranks retrieval and | |
| gives no credit to extraction or consolidation. | |
| ## What this Space is | |
| The repository's `site/` directory, deployed verbatim with no build step. It is the same set of | |
| static pages served from GitHub Pages, mirrored here so that the benchmark is reachable from where | |
| people look for benchmarks. `method.html` states the design, `submit.html` states how a product | |
| gets an arm, and `docs/STATUS.md` in the repository states the dated truth about what has actually | |
| been measured. | |