AI scientists design their own experiments in twins of real laboratories.
Score is the mean of score.derived_100 over the 52 tasks, 0 to 100.
Passed is the number of tasks with score.pass true.
Cost is the spend of the actor agent on the full benchmark, in USD.
scripts/run_batch.py, one run per task, TwinLab agent and judge agent on deepseek-flash).runs/<task>/<time>/run_0/ with result.json, plus batch_config.json and batch_summary.json.entries in results.json.{
"provider": "My Lab",
"provider_url": "https://example.com/my-lab",
"agent": "Claude Code",
"model": "MyModel",
"effort": "high",
"score": 31.4,
"passed": 17,
"actor_usd": 88.5,
"source": "https://example.com/my-twinlab-runs"
}
Every run must be valid. No subset of tasks, no selection among repeated runs.