Upload README.md
Browse files
README.md
CHANGED
|
@@ -136,7 +136,7 @@ We used 10 roleplay prompts in chat. Each was run at `temp 1.0` and at greedy `0
|
|
| 136 |
|
| 137 |
With that caveat, overall trigram overlap vs base was **1.6% at 1.0 and 3.2% at greedy**. Every prompt was under 5%. We saw 5–5.7k words total. Thinking tokens averaged about 2.6k. There were no loops and no empties. The voice was clearly distinct. Greedy was slightly lower on clichés than 1.0. Direction and distinctness align with Gryphe's report.
|
| 138 |
|
| 139 |
-
Details, per-prompt tables, and harness: [`benchmark.md`](./benchmark.md)
|
| 140 |
|
| 141 |
---
|
| 142 |
|
|
@@ -166,7 +166,7 @@ StyleTune-V2, by Gryphe, is built from the regular `gemma-4-26B-A4B-it`, not the
|
|
| 166 |
| `temp 1.0` | 0.18 (10 hits / 5463w) | 0.14 (8 hits / 5563w) | **1.62%** overall (176/10877), per-prompt 0.2–1.9% | All <5%, distinct phrasing |
|
| 167 |
| `greedy 0.0` | 0.12 (6 hits / 5085w) | 0.10 (6 hits / 5723w) | **3.23%** overall (336/10406), per-prompt 1.0–4.8% | Slight canonical convergence, still far below 19.9% |
|
| 168 |
|
| 169 |
-
Full tables, sampler-vs-voice dominance, and per-prompt first-80: [`benchmark.md`](./benchmark.md) (deep, 4 subagents)
|
| 170 |
|
| 171 |
**For official leaderboard submission:** When you have Hub dataset IDs, add YAML files under `.eval_results/` per [Evaluation Results docs](https://huggingface.co/docs/hub/eval-results). This card cites Gryphe's private eval—it does not publish a leaderboard entry.
|
| 172 |
|
|
|
|
| 136 |
|
| 137 |
With that caveat, overall trigram overlap vs base was **1.6% at 1.0 and 3.2% at greedy**. Every prompt was under 5%. We saw 5–5.7k words total. Thinking tokens averaged about 2.6k. There were no loops and no empties. The voice was clearly distinct. Greedy was slightly lower on clichés than 1.0. Direction and distinctness align with Gryphe's report.
|
| 138 |
|
| 139 |
+
Details, per-prompt tables, and harness: [`benchmark.md`](./benchmark.md).
|
| 140 |
|
| 141 |
---
|
| 142 |
|
|
|
|
| 166 |
| `temp 1.0` | 0.18 (10 hits / 5463w) | 0.14 (8 hits / 5563w) | **1.62%** overall (176/10877), per-prompt 0.2–1.9% | All <5%, distinct phrasing |
|
| 167 |
| `greedy 0.0` | 0.12 (6 hits / 5085w) | 0.10 (6 hits / 5723w) | **3.23%** overall (336/10406), per-prompt 1.0–4.8% | Slight canonical convergence, still far below 19.9% |
|
| 168 |
|
| 169 |
+
Full tables, sampler-vs-voice dominance, and per-prompt first-80: [`benchmark.md`](./benchmark.md) (deep, 4 subagents). Harness via `POST /v1/chat/completions` with Gemma 4 chat template and `<|channel>thought` parsing.
|
| 170 |
|
| 171 |
**For official leaderboard submission:** When you have Hub dataset IDs, add YAML files under `.eval_results/` per [Evaluation Results docs](https://huggingface.co/docs/hub/eval-results). This card cites Gryphe's private eval—it does not publish a leaderboard entry.
|
| 172 |
|