File size: 2,168 Bytes
284beba
a98dff5
1e3f4b2
 
 
284beba
1e3f4b2
284beba
1e3f4b2
 
 
 
 
 
 
 
 
 
284beba
 
a98dff5
1e3f4b2
a98dff5
 
 
 
 
1e3f4b2
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
title: ScriptBench Leaderboard
emoji: 🏆
colorFrom: indigo
colorTo: pink
sdk: static
app_file: index.html
pinned: false
license: cc-by-4.0
short_description: Which model writes My Weird Prompts, and how others scored
datasets:
  - My-Weird-Prompts/mwp-script-results
  - My-Weird-Prompts/mwp-censorship-results
tags:
  - leaderboard
  - podcast
  - long-form-writing
  - censorship
---

# ScriptBench — the My Weird Prompts script-writer benchmark

> ScriptBench is our own internal benchmark, open-sourced. It measures one workload: a ~28k-token brief turned into a ~3,800-word, two-host comedic dialogue for text-to-speech. It probably isn't the right benchmark for your use case. Fork it and tailor the task card, rubric and measures to yours.

**Related work:** [PodBench](https://arxiv.org/abs/2601.14903) (Tencent, ACL 2026, arXiv 2601.14903; [code](https://github.com/xucncn/PodBench), MIT) is the closest public benchmark in this space: 800 samples, inputs up to 21k tokens, multi-speaker podcast scripts, deterministic checks plus an LLM judge.

A static page (no build step) that renders the ScriptBench (formerly MWP-Script) benchmark results and the
informal evaluation log. At load it fetches, from the public eval repo's `main` branch:

- [`results/leaderboard.json`](https://github.com/My-Weird-Prompts/eval/blob/main/results/leaderboard.json),
  built by `scripts/build_leaderboard.py` after every run;
- [`results/informal-evaluations.json`](https://github.com/My-Weird-Prompts/eval/blob/main/results/informal-evaluations.json).

So the page updates when those files are pushed; the Space itself only needs redeploying when
the page code changes. Source: [`spaces/leaderboard/`](https://github.com/My-Weird-Prompts/eval/tree/main/spaces/leaderboard),
deployed with `scripts/deploy_leaderboard_space.py`.

Related: [benchmark hub](https://myweirdprompts.com/benchmark) ·
[transcript explorer](https://huggingface.co/spaces/My-Weird-Prompts/transcripts-explorer) ·
[model chronicle](https://huggingface.co/datasets/My-Weird-Prompts/model-chronicle) ·
[per-sample results](https://huggingface.co/datasets/My-Weird-Prompts/mwp-script-results).