Organization card: banner, links, what we publish
Browse files- .gitattributes +1 -0
- README.md +42 -5
- banner.png +3 -0
- index.html +8 -19
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
banner.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,10 +1,47 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
|
|
|
|
|
|
|
|
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Benchgen
|
| 3 |
+
emoji: 馃搳
|
| 4 |
+
colorFrom: yellow
|
| 5 |
+
colorTo: red
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
+
<p align="center">
|
| 10 |
+
<a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=banner"><img src="https://huggingface.co/spaces/benchgen/README/resolve/main/banner.png" alt="Benchgen: the benchmarking infrastructure for AI agents" width="100%"></a>
|
| 11 |
+
</p>
|
| 12 |
|
| 13 |
+
<p align="center">
|
| 14 |
+
<a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-website"><img src="https://img.shields.io/badge/WEBSITE-benchgen.com-F97316?style=for-the-badge&labelColor=111827" alt="Website: benchgen.com"></a>
|
| 15 |
+
<a href="https://benchgen.com/benchmarks/platform/router-fidelity-benchmark?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-benchmark"><img src="https://img.shields.io/badge/RUN%20THE%20BENCHMARK-ROUTER%20FIDELITY-F97316?style=for-the-badge&labelColor=111827" alt="Run the benchmark on Benchgen"></a>
|
| 16 |
+
<a href="https://benchgen.com/docs?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-docs"><img src="https://img.shields.io/badge/DOCS-benchgen.com%2Fdocs-F97316?style=for-the-badge&labelColor=111827" alt="Docs"></a>
|
| 17 |
+
</p>
|
| 18 |
+
|
| 19 |
+
<p align="center">
|
| 20 |
+
<a href="https://github.com/benchgen-ai"><img src="https://img.shields.io/badge/GitHub-benchgen--ai-181717?style=flat&logo=github&logoColor=white" alt="GitHub"></a>
|
| 21 |
+
<a href="https://x.com/BenchGenAI"><img src="https://img.shields.io/badge/X-%40BenchGenAI-000000?style=flat&logo=x&logoColor=white" alt="X"></a>
|
| 22 |
+
<a href="https://www.linkedin.com/company/benchgen"><img src="https://img.shields.io/badge/LinkedIn-benchgen-0A66C2?style=flat" alt="LinkedIn"></a>
|
| 23 |
+
<a href="https://huggingface.co/benchgen"><img src="https://img.shields.io/badge/Hugging%20Face-benchgen-FFD21E?style=flat&logo=huggingface&logoColor=black" alt="Hugging Face"></a>
|
| 24 |
+
</p>
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
**Nobody can prove an AI agent actually works.** Benchgen helps you discover benchmarks, run evaluations on any model or agent, find where and why it fails, and check the fix with the same tests before and after.
|
| 28 |
+
|
| 29 |
+
## What we publish here
|
| 30 |
+
|
| 31 |
+
| Release | What it is | Link |
|
| 32 |
+
|---|---|---|
|
| 33 |
+
| **Router Lite** (model) | A 10,245-parameter linear router head on a frozen Qwen3-1.7B. Picks which of 5 models should answer a query | [benchgen/benchgen-router-lite](https://huggingface.co/benchgen/benchgen-router-lite) |
|
| 34 |
+
| **Router Pilot rewards** (dataset) | Per-question accuracy of 5 agents over 3 attempts (46 tasks) | [benchgen/router-pilot](https://huggingface.co/datasets/benchgen/router-pilot) |
|
| 35 |
+
| **Router Pilot tasks** (dataset) | 1,110 normalized questions from public benchmarks, with per-source licences | [benchgen/router-pilot-tasks](https://huggingface.co/datasets/benchgen/router-pilot-tasks) |
|
| 36 |
+
|
| 37 |
+
Every card states its method, licence, limits and a link to the relevant benchmark on Benchgen.
|
| 38 |
+
|
| 39 |
+
## Run it yourself
|
| 40 |
+
|
| 41 |
+
1. Open the [Router Fidelity Benchmark](https://benchgen.com/benchmarks/platform/router-fidelity-benchmark?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=router-fidelity) (sign-in required to run).
|
| 42 |
+
2. Register your own model or router head, pick it on the Evaluate tab and run.
|
| 43 |
+
3. Compare with our published run. The [Router Lite guide](https://benchgen.com/docs/guides/router-head/benchgen-router-lite?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=guide) has the steps.
|
| 44 |
+
|
| 45 |
+
## Honest limits
|
| 46 |
+
|
| 47 |
+
Our releases are pilots. Router Lite was trained on 46 labelled tasks, and its results are directional, not a large-sample benchmark. Each card says exactly what the numbers do and do not show.
|
banner.png
ADDED
|
Git LFS Details
|
index.html
CHANGED
|
@@ -1,19 +1,8 @@
|
|
| 1 |
-
<!doctype html>
|
| 2 |
-
<
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
<body>
|
| 10 |
-
<div class="card">
|
| 11 |
-
<h1>Welcome to your static Space!</h1>
|
| 12 |
-
<p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
|
| 13 |
-
<p>
|
| 14 |
-
Also don't forget to check the
|
| 15 |
-
<a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
|
| 16 |
-
</p>
|
| 17 |
-
</div>
|
| 18 |
-
</body>
|
| 19 |
-
</html>
|
|
|
|
| 1 |
+
<!doctype html><html><head><meta charset="utf-8"><title>Benchgen</title>
|
| 2 |
+
<style>body{font-family:Segoe UI,Arial,sans-serif;background:#0B0B10;color:#fff;margin:0;padding:48px;max-width:760px;margin:auto}
|
| 3 |
+
a{color:#F97316}img{max-width:100%;border-radius:12px}</style></head><body>
|
| 4 |
+
<a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=index"><img src="banner.png" alt="Benchgen"></a>
|
| 5 |
+
<h1>Benchgen</h1><p>The benchmarking infrastructure for AI agents.</p>
|
| 6 |
+
<p><a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=index-website">benchgen.com</a> 路
|
| 7 |
+
<a href="https://benchgen.com/docs">Docs</a> 路 <a href="https://github.com/benchgen-ai">GitHub</a> 路
|
| 8 |
+
<a href="https://huggingface.co/benchgen">Models and datasets</a></p></body></html>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|