benchgen commited on
Commit
dc09410
路
verified 路
1 Parent(s): a5a3893

Organization card: banner, links, what we publish

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. README.md +42 -5
  3. banner.png +3 -0
  4. index.html +8 -19
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ banner.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,10 +1,47 @@
1
  ---
2
- title: README
3
- emoji: 馃摎
4
- colorFrom: pink
5
- colorTo: yellow
6
  sdk: static
7
  pinned: false
8
  ---
 
 
 
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Benchgen
3
+ emoji: 馃搳
4
+ colorFrom: yellow
5
+ colorTo: red
6
  sdk: static
7
  pinned: false
8
  ---
9
+ <p align="center">
10
+ <a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=banner"><img src="https://huggingface.co/spaces/benchgen/README/resolve/main/banner.png" alt="Benchgen: the benchmarking infrastructure for AI agents" width="100%"></a>
11
+ </p>
12
 
13
+ <p align="center">
14
+ <a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-website"><img src="https://img.shields.io/badge/WEBSITE-benchgen.com-F97316?style=for-the-badge&labelColor=111827" alt="Website: benchgen.com"></a>
15
+ <a href="https://benchgen.com/benchmarks/platform/router-fidelity-benchmark?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-benchmark"><img src="https://img.shields.io/badge/RUN%20THE%20BENCHMARK-ROUTER%20FIDELITY-F97316?style=for-the-badge&labelColor=111827" alt="Run the benchmark on Benchgen"></a>
16
+ <a href="https://benchgen.com/docs?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=badge-docs"><img src="https://img.shields.io/badge/DOCS-benchgen.com%2Fdocs-F97316?style=for-the-badge&labelColor=111827" alt="Docs"></a>
17
+ </p>
18
+
19
+ <p align="center">
20
+ <a href="https://github.com/benchgen-ai"><img src="https://img.shields.io/badge/GitHub-benchgen--ai-181717?style=flat&logo=github&logoColor=white" alt="GitHub"></a>
21
+ <a href="https://x.com/BenchGenAI"><img src="https://img.shields.io/badge/X-%40BenchGenAI-000000?style=flat&logo=x&logoColor=white" alt="X"></a>
22
+ <a href="https://www.linkedin.com/company/benchgen"><img src="https://img.shields.io/badge/LinkedIn-benchgen-0A66C2?style=flat" alt="LinkedIn"></a>
23
+ <a href="https://huggingface.co/benchgen"><img src="https://img.shields.io/badge/Hugging%20Face-benchgen-FFD21E?style=flat&logo=huggingface&logoColor=black" alt="Hugging Face"></a>
24
+ </p>
25
+
26
+
27
+ **Nobody can prove an AI agent actually works.** Benchgen helps you discover benchmarks, run evaluations on any model or agent, find where and why it fails, and check the fix with the same tests before and after.
28
+
29
+ ## What we publish here
30
+
31
+ | Release | What it is | Link |
32
+ |---|---|---|
33
+ | **Router Lite** (model) | A 10,245-parameter linear router head on a frozen Qwen3-1.7B. Picks which of 5 models should answer a query | [benchgen/benchgen-router-lite](https://huggingface.co/benchgen/benchgen-router-lite) |
34
+ | **Router Pilot rewards** (dataset) | Per-question accuracy of 5 agents over 3 attempts (46 tasks) | [benchgen/router-pilot](https://huggingface.co/datasets/benchgen/router-pilot) |
35
+ | **Router Pilot tasks** (dataset) | 1,110 normalized questions from public benchmarks, with per-source licences | [benchgen/router-pilot-tasks](https://huggingface.co/datasets/benchgen/router-pilot-tasks) |
36
+
37
+ Every card states its method, licence, limits and a link to the relevant benchmark on Benchgen.
38
+
39
+ ## Run it yourself
40
+
41
+ 1. Open the [Router Fidelity Benchmark](https://benchgen.com/benchmarks/platform/router-fidelity-benchmark?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=router-fidelity) (sign-in required to run).
42
+ 2. Register your own model or router head, pick it on the Evaluate tab and run.
43
+ 3. Compare with our published run. The [Router Lite guide](https://benchgen.com/docs/guides/router-head/benchgen-router-lite?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=guide) has the steps.
44
+
45
+ ## Honest limits
46
+
47
+ Our releases are pilots. Router Lite was trained on 46 labelled tasks, and its results are directional, not a large-sample benchmark. Each card says exactly what the numbers do and do not show.
banner.png ADDED

Git LFS Details

  • SHA256: 66413e94e69a292fc342ee970dab34696693e1574e6d7c17207ec5a7cdfd18cb
  • Pointer size: 131 Bytes
  • Size of remote file: 263 kB
index.html CHANGED
@@ -1,19 +1,8 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
19
- </html>
 
1
+ <!doctype html><html><head><meta charset="utf-8"><title>Benchgen</title>
2
+ <style>body{font-family:Segoe UI,Arial,sans-serif;background:#0B0B10;color:#fff;margin:0;padding:48px;max-width:760px;margin:auto}
3
+ a{color:#F97316}img{max-width:100%;border-radius:12px}</style></head><body>
4
+ <a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=index"><img src="banner.png" alt="Benchgen"></a>
5
+ <h1>Benchgen</h1><p>The benchmarking infrastructure for AI agents.</p>
6
+ <p><a href="https://benchgen.com/?utm_source=huggingface&utm_medium=org_card&utm_campaign=org&utm_content=index-website">benchgen.com</a> 路
7
+ <a href="https://benchgen.com/docs">Docs</a> 路 <a href="https://github.com/benchgen-ai">GitHub</a> 路
8
+ <a href="https://huggingface.co/benchgen">Models and datasets</a></p></body></html>