Spaces:
Running
Running
File size: 190,078 Bytes
fe170ba dc5fa28 0665cbb dc5fa28 0665cbb dc5fa28 0665cbb dc5fa28 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 | <!doctype html>
<html lang="en"><head>
<meta charset="utf-8"><meta name="viewport" content="width=device-width,initial-scale=1">
<title>Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes</title><meta name="description" content="A benchmark of 190 Unreal Engine cases that scores the engine-native scenes coding agents build and edit.">
<link rel="icon" href="data:image/svg+xml,<svg viewBox='0 0 32 32' aria-hidden='true'><defs><linearGradient id='gi' x1='0' y1='0' x2='1' y2='1'><stop offset='0' stop-color='%2392400e'/><stop offset='1' stop-color='%23d97706'/></linearGradient></defs><rect x='1' y='1' width='30' height='30' rx='8' fill='url(%23gi)'/><path d='M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z' fill='none' stroke='%23fff' stroke-width='2' stroke-linejoin='round'/><path d='M7 11.5 16 16.5 25 11.5M16 16.5v9' fill='none' stroke='%23fff' stroke-width='2' stroke-linejoin='round'/></svg>">
<link rel="preconnect" href="https://fonts.googleapis.com"><link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=Inter:wght@300;400;500;600;700;800;900&family=DM+Sans:wght@400;500&family=JetBrains+Mono:wght@400;500&display=swap">
<link rel="stylesheet" href="assets/paper.css?v=5427505a">
<style>
:root{--c4s-a:#5a67d8;--c4s-b:#d97706;--c4s-hot:#dc4a2d;--c4s-ok:#0f9f6e;--c4s-g1:#8b93a7;--c4s-g2:#aab1c2;--c4s-g3:#cdd2de;--c4s-seq:#5a67d8;--c4s-unit:#e3e7f0}
svg.ch{width:100%;height:auto;display:block;font-family:Inter,system-ui,sans-serif;overflow:visible}
svg.ch text{fill:var(--text-secondary);font-size:13px}svg.ch .b{fill:var(--text-primary);font-weight:700}svg.ch .m{fill:var(--text-muted);font-size:12px}
svg.ch .num{font-variant-numeric:tabular-nums}svg.ch .grid{stroke:var(--line-soft);stroke-width:1}svg.ch .axis{stroke:var(--line-strong);stroke-width:1}
svg.ch .dim{opacity:.42}svg.ch g.row:hover{opacity:1}svg.ch .hot{fill:var(--c4s-hot)!important;font-weight:700}
.ch-legend{display:flex;flex-wrap:wrap;gap:6px 18px;margin:0 0 10px;font-size:13px;color:var(--text-secondary)}
.ch-legend span{display:inline-flex;align-items:center;gap:7px}.ch-legend i{width:12px;height:12px;border-radius:3px;display:inline-block}
.ev{position:relative;border-radius:var(--radius-sm);overflow:hidden;border:1px solid var(--line-soft)}.ev img{display:block;width:100%}
.ev svg{position:absolute;inset:0;width:100%;height:100%}
.chips{display:flex;flex-wrap:wrap;gap:8px;margin-top:10px}.chip{font-size:13px;font-weight:600;padding:4px 10px;border-radius:999px;border:1px solid var(--line)}
.chip.ok{color:var(--c4s-ok);border-color:currentColor}.chip.no{color:var(--c4s-hot);border-color:currentColor}.chip small{font-weight:500;color:var(--text-muted);margin-left:4px}
.bigstats{display:flex;flex-wrap:wrap;gap:12px 34px;margin:0 0 12px}.bigstats b{display:block;font-size:30px;letter-spacing:-.02em;font-variant-numeric:tabular-nums}
.bigstats span{font-size:13px;color:var(--text-secondary)}
</style></head><body>
<nav class="navbar"><a class="navbar-brand" href="index.html"><svg viewBox="0 0 32 32" aria-hidden="true"><defs><linearGradient id="gi" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#92400e"/><stop offset="1" stop-color="#d97706"/></linearGradient></defs><rect x="1" y="1" width="30" height="30" rx="8" fill="url(#gi)"/><path d="M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/><path d="M7 11.5 16 16.5 25 11.5M16 16.5v9" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/></svg>Code4Scene</a><ul class="navbar-links"><li class=""><a href="index.html#leaderboard" class=on>Leaderboard</a></li><li class="hide-sm"><a href="index.html#takeaways">Takeaways</a></li><li class=""><a href="cases.html">Cases in 3D</a></li><li class="hide-sm"><a href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> Code</a></li><li><a class="btn-nav-primary" href="https://simworld.org/" target="_blank" rel="noopener"><img src="img/simworld-logo.png" alt="">SimWorld Home</a></li></ul></nav>
<section class="hero" id="hero"><div class="hero-inner">
<h1 class="hero-title"><svg viewBox="0 0 32 32" aria-hidden="true"><defs><linearGradient id="gi" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#92400e"/><stop offset="1" stop-color="#d97706"/></linearGradient></defs><rect x="1" y="1" width="30" height="30" rx="8" fill="url(#gi)"/><path d="M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/><path d="M7 11.5 16 16.5 25 11.5M16 16.5v9" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/></svg><span class="highlight">Code4Scene</span>:<br>Benchmarking Coding Agents for<br>Constructing and Editing 3D Scenes</h1>
<p class="hero-subtitle">190 Unreal Engine cases built from human-assembled scenes. Coding agents write and run code that builds a scene from text, or
repairs one from reference images, and Code4Scene scores the engine-native scene they save, not their code or a rendered view.</p>
<p class="hero-authors"><span class="author">Xiaokang Ye</span><sup>1,*</sup>, <span class="author">Siddhant Hitesh Mantri</span><sup>1,*</sup>,
<span class="author">Zimeng Chen</span><sup>1,*</sup>, <span class="author">Edward Zhang</span><sup>1</sup>, <span class="author">Zhaoxu Zheng</span><sup>1</sup>,<br>
<span class="author">Yuanheng Li</span><sup>2</sup>, <span class="author">Yizhao Chen</span><sup>1</sup>, <span class="author">Tianyang Huang</span><sup>1</sup>,
<span class="author">Lianhui Qin</span><sup>1,†</sup></p>
<p class="hero-affiliations"><sup>1</sup>University of California San Diego <sup>2</sup>University of California, Berkeley
<sup>*</sup>Equal contribution <sup>†</sup>Corresponding author</p>
<div class="hero-buttons"><span class="btn btn-primary off" title="Coming soon"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M4 0h5.5L14 4.5V14a2 2 0 01-2 2H4a2 2 0 01-2-2V2a2 2 0 012-2zm5 1.5V5h3.5L9 1.5zM5 8h6v1H5zm0 2.5h6v1H5z"/></svg> Paper (soon)</span>
<a class="btn btn-outline" href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> Code & Data</a>
<a class="btn btn-dark" href="#teaser"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0a8 8 0 110 16A8 8 0 018 0zM6.5 4.8v6.4L11.3 8z"/></svg> Watch the teaser</a><a class="btn btn-dark" href="cases.html"><svg viewBox="0 0 16 16" fill="none" stroke="currentColor" stroke-width="1.5" aria-hidden="true"><path d="M8 1.5l5.5 3v7L8 14.5l-5.5-3v-7z"/><path d="M2.5 4.5L8 7.5l5.5-3M8 7.5v7"/></svg> Cases in 3D</a></div>
<div class="hero-stats">
<div class="hero-stat"><div class="stat-num"><span>190</span></div><div class="stat-label">Unreal Engine cases</div><div class="stat-note">95 public, scored here</div></div>
<div class="hero-stat"><div class="stat-num"><span>14</span></div><div class="stat-label">coding-agent configurations</div><div class="stat-note">frontier and open weights</div></div>
<div class="hero-stat"><div class="stat-num"><span>0.619</span></div><div class="stat-label">best overall score</div><div class="stat-note">Astra and Gemini, tied</div></div>
<div class="hero-stat"><div class="stat-num"><span>35.8%</span></div><div class="stat-label">of complete repairs</div><div class="stat-note">still change the rest of the scene</div></div>
</div></div></section><section class="dark" id="teaser"><div class="container">
<div class="section-header centered"><span class="section-label">Teaser</span><h2 class="section-title">How Code4Scene scores a scene</h2>
<p class="section-desc">The leaderboard, one scene through the evaluator, two scenes compared, and what the benchmark finds, in 90 seconds.</p></div>
<div class="teaser-frame"><video controls playsinline preload="metadata" poster="media/teaser-poster.jpg"><source src="media/teaser.mp4" type="video/mp4"></video></div>
</div></section><section class="alt" id="overview"><div class="container">
<div class="section-header centered"><span class="section-label">Overview</span><h2 class="section-title">Score the scene, not the code or a render</h2></div>
<div class="card abstract-card"><p>Coding agents can now operate 3D engines: they write and run code, inspect the result and revise the scene. Code4Scene is a
benchmark of 190 Unreal Engine cases built from human-assembled scenes that evaluates them on two complementary settings under a shared execution
interface. <b>Construction</b> starts from an empty level and an open-ended text specification. <b>Editing</b> gives the agent a corrupted copy of a
scene and reference images of the original, and asks it to restore the intended state while leaving everything else untouched.</p>
<p>Rather than scoring code or rendered views, Code4Scene evaluates the engine-native scene the agent saved, on task fulfilment, artifact integrity
and static physical validity, and compares edits against withheld ground truth. Across 14 agent configurations, construction and editing rank the
agents differently, spatial relations remain the weakest requirement family, and a third of complete repairs still change the surrounding scene.</p></div>
<div class="flow"><div class="step"><span class="n">1 · Input</span><b>Prompt or reference</b><span>An open-ended scene description, or a corrupted scene with reference images of the original.</span></div><div class="step"><span class="n">2 · Agent</span><b>Coding agent</b><span>A frontier or open-weight model in its own CLI harness, with the Unreal Engine editor as a tool.</span></div><div class="step"><span class="n">3 · Code</span><b>Code in the engine</b><span>It writes and runs Python against the editor: spawns, moves and edits actors, inspects, revises.</span></div><div class="step"><span class="n">4 · Scene</span><b>Engine-native scene</b><span>The saved level (.umap): every actor, transform and material, as the engine holds it.</span></div><div class="step eval"><span class="n">5 · Evaluator</span><b>Scored in the engine</b><span>Requirements located and judged, overview views judged, physics measured, edits diffed against the withheld ground truth.</span></div></div>
<div class="grid2" style="margin-top:2rem">
<div class="card setting-card"><span class="kicker">Setting 1 · construction</span><h3>Text-to-Scene</h3>
<p>From an empty level and the content pack's asset catalog, the agent builds the scene a prompt describes. Many realizations are valid, so the
evaluator judges requirements rather than matching a reference. 20 public cases.</p>
<div class="formula">case score = 0.2 × Detailed Alignment + 0.6 × Overview Alignment + 0.2 × Physical Safety</div></div>
<div class="card setting-card"><span class="kicker">Setting 2 · editing</span><h3>Image-to-Scene</h3>
<p>The agent gets a corrupted copy of a human-assembled scene and reference views of the original. It must restore every target actor (within
5 cm, 5° and 5%) and change nothing else. 75 public cases: 25 indoor, 50 outdoor.</p>
<div class="formula">case score = 0.8 × Repair F1 + 0.2 × Physical Safety</div></div></div>
</div></section><section id="leaderboard"><div class="container">
<div class="section-header centered"><span class="section-label">Leaderboard</span><h2 class="section-title">14 coding agents on the public set</h2>
<p class="section-desc">Scores are from the paper's Table 2. Pick a setting; the chart and the table follow.</p></div>
<div id="lbwrap"><div class="lb-tabs"><div class="seg seg-lg" data-for="lbwrap"><button data-view="overall" class=on>Overall</button><button data-view="t2s">Text-to-Scene</button><button data-view="i2s">Image-to-Scene</button></div></div>
<div class="card chart-card"><div class="sub-title">Score against cost</div>
<div class="sub-desc">Each agent's score against what one case cost it. The line is the frontier: no agent left of it scores higher. Hover a point for its numbers.</div>
<div class="ch-legend"><span><i style="background:#0f9f6e;border-radius:50%"></i>OpenAI</span><span><i style="background:#3b82f6;border-radius:50%"></i>Google</span><span><i style="background:#c2410c;border-radius:50%"></i>Anthropic</span><span><i style="background:#8b5cf6;border-radius:50%"></i>Meta</span><span><i style="background:#475569;border-radius:50%"></i>Z.ai</span><span><i style="background:#f59e0b;border-radius:50%"></i>Alibaba</span><span><i style="background:#e11d48;border-radius:50%"></i>xAI</span><span><i style="background:#a16207;border-radius:50%"></i>Thinking Machines</span><span><i style="background:#06b6d4;border-radius:50%"></i>DeepSeek</span><span><i style="background:#fff;border:2px solid var(--text-h);border-radius:50%;box-sizing:border-box"></i>on the frontier</span></div><svg class="ch pareto" viewBox="0 0 900 400" role="img" aria-label="Score against estimated cost per case"><g data-view="overall"><line class="grid" x1="52" x2="880" y1="323.1" y2="323.1"/><text x="44" y="327.1" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="261.3" y2="261.3"/><text x="44" y="265.3" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="199.5" y2="199.5"/><text x="44" y="203.5" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="137.6" y2="137.6"/><text x="44" y="141.6" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="75.8" y2="75.8"/><text x="44" y="79.8" text-anchor="end" class="m num">0.60</text><line class="grid" x1="52" x2="880" y1="14.0" y2="14.0"/><text x="44" y="18.0" text-anchor="end" class="m num">0.70</text><text x="158.9" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="158.9" x2="158.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="283.9" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="283.9" x2="283.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="397.9" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="397.9" x2="397.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="522.9" y="372" text-anchor="middle" class="m num">$1</text><line x1="522.9" x2="522.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="637.0" y="372" text-anchor="middle" class="m num">$3</text><line x1="637.0" x2="637.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="762.0" y="372" text-anchor="middle" class="m num">$10</text><line x1="762.0" x2="762.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="876.0" y="372" text-anchor="middle" class="m num">$30</text><line x1="876.0" x2="876.0" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M100.8,270.5 L147.4,270.5 L147.4,262.5 L268.3,262.5 L268.3,136.4 L590.8,136.4 L590.8,64.1 L880.0,64.1 L880,354 L100.8,354 Z"/><path class="frontier" d="M100.8,270.5 L147.4,270.5 L147.4,262.5 L268.3,262.5 L268.3,136.4 L590.8,136.4 L590.8,64.1 L880.0,64.1"/><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Overall", "0.619"], ["cost per case", "$1.92"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="590.8" cy="64.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Overall", "0.502"], ["cost per case", "$0.09"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="268.3" cy="136.4" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Overall", "0.298"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="147.4" cy="262.5" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Overall", "0.285"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="100.8" cy="270.5" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Overall", "0.619"], ["cost per case", "$12.90"], ["provider", "OpenAI"]]}'><circle cx="788.4" cy="64.1" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Overall", "0.606"], ["cost per case", "$10.62"], ["provider", "Anthropic"]]}'><circle cx="768.3" cy="72.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Overall", "0.593"], ["cost per case", "$19.48"], ["provider", "Anthropic"]]}'><circle cx="831.2" cy="80.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Overall", "0.550"], ["cost per case", "$2.97"], ["provider", "OpenAI"]]}'><circle cx="636.1" cy="106.7" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Overall", "0.415"], ["cost per case", "$0.40"], ["provider", "Z.ai"]]}'><circle cx="428.1" cy="190.2" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Overall", "0.378"], ["cost per case", "$0.38"], ["provider", "Alibaba"]]}'><circle cx="423.6" cy="213.1" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Overall", "0.376"], ["cost per case", "$2.29"], ["provider", "xAI"]]}'><circle cx="609.2" cy="214.3" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Overall", "0.371"], ["cost per case", "$0.30"], ["provider", "Alibaba"]]}'><circle cx="397.1" cy="217.4" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Overall", "0.312"], ["cost per case", "$0.48"], ["provider", "Thinking Machines"]]}'><circle cx="446.4" cy="253.9" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Overall", "0.227"], ["cost per case", "$0.12"], ["provider", "DeepSeek"]]}'><circle cx="306.2" cy="306.4" r="5.5" fill="#06b6d4" stroke="#fff" stroke-width="1.5"/></g><text x="580.8" y="68.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="258.3" y="140.4" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="147.4" y="250.5" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="100.8" y="290.5" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="788.4" y="52.1" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="768.3" y="92.1" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="841.2" y="84.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="646.1" y="110.7" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="438.1" y="194.2" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="433.6" y="217.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="619.2" y="218.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text><text x="387.1" y="221.4" text-anchor="end" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="456.4" y="257.9" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="316.2" y="310.4" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text></g><g data-view="t2s" style="display:none"><line class="grid" x1="52" x2="880" y1="329.7" y2="329.7"/><text x="44" y="333.7" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="281.1" y2="281.1"/><text x="44" y="285.1" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="232.6" y2="232.6"/><text x="44" y="236.6" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="184.0" y2="184.0"/><text x="44" y="188.0" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="135.4" y2="135.4"/><text x="44" y="139.4" text-anchor="end" class="m num">0.60</text><line class="grid" x1="52" x2="880" y1="86.9" y2="86.9"/><text x="44" y="90.9" text-anchor="end" class="m num">0.70</text><line class="grid" x1="52" x2="880" y1="38.3" y2="38.3"/><text x="44" y="42.3" text-anchor="end" class="m num">0.80</text><text x="57.1" y="372" text-anchor="middle" class="m num">$0.01</text><line x1="57.1" x2="57.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="162.1" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="162.1" x2="162.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="277.0" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="277.0" x2="277.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="382.0" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="382.0" x2="382.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="497.0" y="372" text-anchor="middle" class="m num">$1</text><line x1="497.0" x2="497.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="601.9" y="372" text-anchor="middle" class="m num">$3</text><line x1="601.9" x2="601.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="716.9" y="372" text-anchor="middle" class="m num">$10</text><line x1="716.9" x2="716.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="821.8" y="372" text-anchor="middle" class="m num">$30</text><line x1="821.8" x2="821.8" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M96.9,205.9 L145.8,205.9 L145.8,198.1 L277.5,198.1 L277.5,113.1 L584.3,113.1 L584.3,107.7 L631.1,107.7 L631.1,83.5 L773.8,83.5 L773.8,44.1 L880.0,44.1 L880,354 L96.9,354 Z"/><path class="frontier" d="M96.9,205.9 L145.8,205.9 L145.8,198.1 L277.5,198.1 L277.5,113.1 L584.3,113.1 L584.3,107.7 L631.1,107.7 L631.1,83.5 L773.8,83.5 L773.8,44.1 L880.0,44.1"/><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Text-to-Scene", "0.788"], ["cost per case", "$18.16"], ["provider", "Anthropic"], ["", "on the frontier"]]}'><circle cx="773.8" cy="44.1" r="7" fill="#c2410c" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Text-to-Scene", "0.707"], ["cost per case", "$4.07"], ["provider", "OpenAI"], ["", "on the frontier"]]}'><circle cx="631.1" cy="83.5" r="7" fill="#0f9f6e" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Text-to-Scene", "0.657"], ["cost per case", "$2.49"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="584.3" cy="107.7" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Text-to-Scene", "0.646"], ["cost per case", "$0.10"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="277.5" cy="113.1" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Text-to-Scene", "0.471"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="145.8" cy="198.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Text-to-Scene", "0.455"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="96.9" cy="205.9" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Text-to-Scene", "0.724"], ["cost per case", "$22.47"], ["provider", "OpenAI"]]}'><circle cx="794.2" cy="75.2" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Text-to-Scene", "0.718"], ["cost per case", "$34.50"], ["provider", "Anthropic"]]}'><circle cx="835.1" cy="78.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Text-to-Scene", "0.567"], ["cost per case", "$4.33"], ["provider", "xAI"]]}'><circle cx="636.8" cy="151.5" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Text-to-Scene", "0.557"], ["cost per case", "$0.49"], ["provider", "Alibaba"]]}'><circle cx="429.1" cy="156.3" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Text-to-Scene", "0.516"], ["cost per case", "$0.33"], ["provider", "Alibaba"]]}'><circle cx="392.3" cy="176.2" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Text-to-Scene", "0.509"], ["cost per case", "$0.71"], ["provider", "Z.ai"]]}'><circle cx="464.3" cy="179.6" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Text-to-Scene", "0.425"], ["cost per case", "$0.20"], ["provider", "Thinking Machines"]]}'><circle cx="344.4" cy="220.4" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Text-to-Scene", "0.243"], ["cost per case", "$0.19"], ["provider", "DeepSeek"]]}'><circle cx="340.3" cy="308.8" r="5.5" fill="#06b6d4" stroke="#fff" stroke-width="1.5"/></g><text x="763.8" y="48.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="621.1" y="87.5" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="584.3" y="127.7" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="267.5" y="117.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="145.8" y="186.1" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="96.9" y="225.9" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="794.2" y="63.2" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="845.1" y="82.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="646.8" y="155.5" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text><text x="439.1" y="160.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="402.3" y="180.2" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="474.3" y="183.6" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="354.4" y="224.4" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="350.3" y="312.8" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text></g><g data-view="i2s" style="display:none"><line class="grid" x1="52" x2="880" y1="325.7" y2="325.7"/><text x="44" y="329.7" text-anchor="end" class="m num">0.10</text><line class="grid" x1="52" x2="880" y1="269.0" y2="269.0"/><text x="44" y="273.0" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="212.3" y2="212.3"/><text x="44" y="216.3" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="155.7" y2="155.7"/><text x="44" y="159.7" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="99.0" y2="99.0"/><text x="44" y="103.0" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="42.3" y2="42.3"/><text x="44" y="46.3" text-anchor="end" class="m num">0.60</text><text x="171.1" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="171.1" x2="171.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="327.1" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="327.1" x2="327.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="469.4" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="469.4" x2="469.4" y1="354" y2="358" stroke="var(--line-strong)"/><text x="625.4" y="372" text-anchor="middle" class="m num">$1</text><line x1="625.4" x2="625.4" y1="354" y2="358" stroke="var(--line-strong)"/><text x="767.7" y="372" text-anchor="middle" class="m num">$3</text><line x1="767.7" x2="767.7" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M112.9,317.2 L164.2,317.2 L164.2,310.9 L247.8,310.9 L247.8,263.3 L284.1,263.3 L284.1,179.5 L664.5,179.5 L664.5,53.1 L880.0,53.1 L880,354 L112.9,354 Z"/><path class="frontier" d="M112.9,317.2 L164.2,317.2 L164.2,310.9 L247.8,310.9 L247.8,263.3 L284.1,263.3 L284.1,179.5 L664.5,179.5 L664.5,53.1 L880.0,53.1"/><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Image-to-Scene", "0.581"], ["cost per case", "$1.35"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="664.5" cy="53.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Image-to-Scene", "0.358"], ["cost per case", "$0.07"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="284.1" cy="179.5" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Image-to-Scene", "0.210"], ["cost per case", "$0.05"], ["provider", "DeepSeek"], ["", "on the frontier"]]}'><circle cx="247.8" cy="263.3" r="7" fill="#06b6d4" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Image-to-Scene", "0.126"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="164.2" cy="310.9" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Image-to-Scene", "0.115"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="112.9" cy="317.2" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Image-to-Scene", "0.515"], ["cost per case", "$3.32"], ["provider", "OpenAI"]]}'><circle cx="780.9" cy="90.5" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Image-to-Scene", "0.468"], ["cost per case", "$4.46"], ["provider", "Anthropic"]]}'><circle cx="819.1" cy="117.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Image-to-Scene", "0.424"], ["cost per case", "$3.09"], ["provider", "Anthropic"]]}'><circle cx="771.5" cy="142.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Image-to-Scene", "0.393"], ["cost per case", "$1.88"], ["provider", "OpenAI"]]}'><circle cx="707.0" cy="159.6" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Image-to-Scene", "0.320"], ["cost per case", "$0.09"], ["provider", "Z.ai"]]}'><circle cx="316.4" cy="201.0" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Image-to-Scene", "0.226"], ["cost per case", "$0.26"], ["provider", "Alibaba"]]}'><circle cx="451.2" cy="254.3" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Image-to-Scene", "0.200"], ["cost per case", "$0.28"], ["provider", "Alibaba"]]}'><circle cx="459.0" cy="269.0" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Image-to-Scene", "0.198"], ["cost per case", "$0.75"], ["provider", "Thinking Machines"]]}'><circle cx="588.9" cy="270.1" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Image-to-Scene", "0.184"], ["cost per case", "$0.26"], ["provider", "xAI"]]}'><circle cx="452.6" cy="278.1" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><text x="654.5" y="57.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="274.1" y="183.5" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="237.8" y="267.3" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text><text x="164.2" y="298.9" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="112.9" y="337.2" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="790.9" y="94.5" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="829.1" y="121.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="781.5" y="146.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="717.0" y="163.6" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="326.4" y="205.0" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="461.2" y="258.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="469.0" y="273.0" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="598.9" y="274.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="442.6" y="282.1" text-anchor="end" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text></g><text x="466.0" y="396" text-anchor="middle" class="m">estimated cost per case (US$, log scale)</text><text x="14" y="184.0" text-anchor="middle" class="m" transform="rotate(-90 14 184.0)">score</text></svg>
<p class="note">Cost is the mean reported cost of one run, estimated from its token usage at the provider's list price (paper Figure 1b; provisional).</p></div>
<div class="card" style="padding:1.4rem 1.5rem 1.2rem"><div class="sub-title">Ranking</div><div data-view="overall"><p class="board-note" style="margin:0 .2rem .7rem">Overall = ½ Text-to-Scene + ½ Image-to-Scene over the 95 public cases; its cost is weighted the same way.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="sm" data-best="high" class=sorted>Overall</th><th data-k="st" data-best="high">Text-to-Scene</th><th data-k="si" data-best="high">Image-to-Scene</th><th data-k="c_all" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.619"><div class="cellbar"><i style="width:80.0px;--bar:var(--primary)"></i><b>0.619</b></div></td><td data-v="0.724" class="dim">0.724</td><td data-v="0.515" class="dim">0.515</td><td data-v="12.896991822966507" class="dim">$12.90</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-2)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-2" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.619"><div class="cellbar"><i style="width:80.0px;--bar:var(--primary)"></i><b>0.619</b></div></td><td data-v="0.657" class="dim">0.657</td><td data-v="0.581" class="dim">0.581</td><td data-v="1.9235185771258503" class="dim">$1.92</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="org">Anthropic</span></td><td data-v="0.606"><div class="cellbar"><i style="width:78.3px;--bar:var(--primary)"></i><b>0.606</b></div></td><td data-v="0.788" class="dim">0.788</td><td data-v="0.424" class="dim">0.424</td><td data-v="10.623258766403161" class="dim">$10.62</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.593"><div class="cellbar"><i style="width:76.6px;--bar:var(--primary)"></i><b>0.593</b></div></td><td data-v="0.718" class="dim">0.718</td><td data-v="0.468" class="dim">0.468</td><td data-v="19.47789116793412" class="dim">$19.48</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="org">OpenAI</span></td><td data-v="0.55"><div class="cellbar"><i style="width:71.1px;--bar:var(--primary)"></i><b>0.550</b></div></td><td data-v="0.707" class="dim">0.707</td><td data-v="0.393" class="dim">0.393</td><td data-v="2.9749956842592593" class="dim">$2.97</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.502"><div class="cellbar"><i style="width:64.9px;--bar:var(--primary)"></i><b>0.502</b></div></td><td data-v="0.646" class="dim">0.646</td><td data-v="0.358" class="dim">0.358</td><td data-v="0.0861066423076923" class="dim">$0.09</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.415"><div class="cellbar"><i style="width:53.6px;--bar:var(--primary)"></i><b>0.415</b></div></td><td data-v="0.509" class="dim">0.509</td><td data-v="0.32" class="dim">0.320</td><td data-v="0.40130584861111107" class="dim">$0.40</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.378"><div class="cellbar"><i style="width:48.9px;--bar:var(--primary)"></i><b>0.378</b></div></td><td data-v="0.557" class="dim">0.557</td><td data-v="0.2" class="dim">0.200</td><td data-v="0.38413493183103564" class="dim">$0.38</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.376"><div class="cellbar"><i style="width:48.6px;--bar:var(--primary)"></i><b>0.376</b></div></td><td data-v="0.567" class="dim">0.567</td><td data-v="0.184" class="dim">0.184</td><td data-v="2.2948689296296294" class="dim">$2.29</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.371"><div class="cellbar"><i style="width:47.9px;--bar:var(--primary)"></i><b>0.371</b></div></td><td data-v="0.516" class="dim">0.516</td><td data-v="0.226" class="dim">0.226</td><td data-v="0.29748765575757574" class="dim">$0.30</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg>
</span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.312"><div class="cellbar"><i style="width:40.3px;--bar:var(--primary)"></i><b>0.312</b></div></td><td data-v="0.425" class="dim">0.425</td><td data-v="0.198" class="dim">0.198</td><td data-v="0.4783280191269841" class="dim">$0.48</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-12)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-12" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.298"><div class="cellbar"><i style="width:38.5px;--bar:var(--primary)"></i><b>0.298</b></div></td><td data-v="0.471" class="dim">0.471</td><td data-v="0.126" class="dim">0.126</td><td data-v="0.026867125396825398" class="dim">$0.03</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-13)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-13" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.285"><div class="cellbar"><i style="width:36.8px;--bar:var(--primary)"></i><b>0.285</b></div></td><td data-v="0.455" class="dim">0.455</td><td data-v="0.115" class="dim">0.115</td><td data-v="0.017148714965986397" class="dim">$0.02</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="org">DeepSeek</span></td><td data-v="0.227"><div class="cellbar"><i style="width:29.3px;--bar:var(--primary)"></i><b>0.227</b></div></td><td data-v="0.243" class="dim">0.243</td><td data-v="0.21" class="dim">0.210</td><td data-v="0.1240297601010101" class="dim">$0.12</td></tr></tbody></table></div></div><div data-view="t2s" style="display:none"><p class="board-note" style="margin:0 .2rem .7rem">20 public cases. Case score = 0.2 × Detailed + 0.6 × Overview + 0.2 × Physical. Detailed and Overview are means of the per-case scores.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="st" data-best="high" class=sorted>Score</th><th data-k="detailed" data-best="high">Detailed</th><th data-k="overview" data-best="high">Overview</th><th data-k="pt" data-best="high">Physical</th><th data-k="c_t2s" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="tag front">Pareto</span><span class="org">Anthropic</span></td><td data-v="0.788"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-a)"></i><b>0.788</b></div></td><td data-v="0.7253149999999999" class="dim">0.725</td><td data-v="0.7717050000000001" class="dim">0.772</td><td data-v="0.898" class="dim">0.898</td><td data-v="18.1576316" class="dim">$18.16</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.724"><div class="cellbar"><i style="width:73.5px;--bar:var(--c4s-a)"></i><b>0.724</b></div></td><td data-v="0.707165" class="dim">0.707</td><td data-v="0.733235" class="dim">0.733</td><td data-v="0.712" class="dim">0.712</td><td data-v="22.472260736842106" class="dim">$22.47</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.718"><div class="cellbar"><i style="width:72.9px;--bar:var(--c4s-a)"></i><b>0.718</b></div></td><td data-v="0.63106" class="dim">0.631</td><td data-v="0.71617" class="dim">0.716</td><td data-v="0.811" class="dim">0.811</td><td data-v="34.49611078947368" class="dim">$34.50</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="tag front">Pareto</span><span class="org">OpenAI</span></td><td data-v="0.707"><div class="cellbar"><i style="width:71.8px;--bar:var(--c4s-a)"></i><b>0.707</b></div></td><td data-v="0.63186" class="dim">0.632</td><td data-v="0.710485" class="dim">0.710</td><td data-v="0.772" class="dim">0.772</td><td data-v="4.07260365" class="dim">$4.07</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-19)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-19" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.657"><div class="cellbar"><i style="width:66.7px;--bar:var(--c4s-a)"></i><b>0.657</b></div></td><td data-v="0.6369100000000001" class="dim">0.637</td><td data-v="0.66406" class="dim">0.664</td><td data-v="0.655" class="dim">0.655</td><td data-v="2.49471265" class="dim">$2.49</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.646"><div class="cellbar"><i style="width:65.6px;--bar:var(--c4s-a)"></i><b>0.646</b></div></td><td data-v="0.5981099999999999" class="dim">0.598</td><td data-v="0.660675" class="dim">0.661</td><td data-v="0.651" class="dim">0.651</td><td data-v="0.10048539999999999" class="dim">$0.10</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.567"><div class="cellbar"><i style="width:57.6px;--bar:var(--c4s-a)"></i><b>0.567</b></div></td><td data-v="0.52211" class="dim">0.522</td><td data-v="0.5764199999999999" class="dim">0.576</td><td data-v="0.585" class="dim">0.585</td><td data-v="4.326270533333333" class="dim">$4.33</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.557"><div class="cellbar"><i style="width:56.5px;--bar:var(--c4s-a)"></i><b>0.557</b></div></td><td data-v="0.506755" class="dim">0.507</td><td data-v="0.529525" class="dim">0.530</td><td data-v="0.688" class="dim">0.688</td><td data-v="0.49154169999999997" class="dim">$0.49</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.516"><div class="cellbar"><i style="width:52.4px;--bar:var(--c4s-a)"></i><b>0.516</b></div></td><td data-v="0.50522" class="dim">0.505</td><td data-v="0.45978" class="dim">0.460</td><td data-v="0.694" class="dim">0.694</td><td data-v="0.3344125" class="dim">$0.33</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.509"><div class="cellbar"><i style="width:51.7px;--bar:var(--c4s-a)"></i><b>0.509</b></div></td><td data-v="0.403365" class="dim">0.403</td><td data-v="0.537015" class="dim">0.537</td><td data-v="0.533" class="dim">0.533</td><td data-v="0.710521125" class="dim">$0.71</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-25)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-25" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.471"><div class="cellbar"><i style="width:47.8px;--bar:var(--c4s-a)"></i><b>0.471</b></div></td><td data-v="0.4117" class="dim">0.412</td><td data-v="0.41593" class="dim">0.416</td><td data-v="0.694" class="dim">0.694</td><td data-v="0.0253001" class="dim">$0.03</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-26)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-26" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.455"><div class="cellbar"><i style="width:46.2px;--bar:var(--c4s-a)"></i><b>0.455</b></div></td><td data-v="0.43810000000000004" class="dim">0.438</td><td data-v="0.370465" class="dim">0.370</td><td data-v="0.725" class="dim">0.725</td><td data-v="0.0151612" class="dim">$0.02</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg>
</span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.425"><div class="cellbar"><i style="width:43.1px;--bar:var(--c4s-a)"></i><b>0.425</b></div></td><td data-v="0.392605" class="dim">0.393</td><td data-v="0.336705" class="dim">0.337</td><td data-v="0.722" class="dim">0.722</td><td data-v="0.20252835" class="dim">$0.20</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="org">DeepSeek</span></td><td data-v="0.243"><div class="cellbar"><i style="width:24.7px;--bar:var(--c4s-a)"></i><b>0.243</b></div></td><td data-v="0.216595" class="dim">0.217</td><td data-v="0.16134500000000002" class="dim">0.161</td><td data-v="0.513" class="dim">0.513</td><td data-v="0.193865" class="dim">$0.19</td></tr></tbody></table></div></div><div data-view="i2s" style="display:none"><p class="board-note" style="margin:0 .2rem .7rem">75 public cases (25 indoor, 50 outdoor). Case score = 0.8 × Repair F1 + 0.2 × Physical. Repair F1 counts target actors restored to the withheld ground truth.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="si" data-best="high" class=sorted>Score</th><th data-k="f1" data-best="high">Repair F1</th><th data-k="pi" data-best="high">Physical</th><th data-k="indoor" data-best="high">Indoor</th><th data-k="outdoor" data-best="high">Outdoor</th><th data-k="c_i2s" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-29)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-29" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.581"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-b)"></i><b>0.581</b></div></td><td data-v="0.527" class="dim">0.527</td><td data-v="0.796" class="dim">0.796</td><td data-v="0.71653332" class="dim">0.717</td><td data-v="0.5133234200000001" class="dim">0.513</td><td data-v="1.3523245042517007" class="dim">$1.35</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.515"><div class="cellbar"><i style="width:70.9px;--bar:var(--c4s-b)"></i><b>0.515</b></div></td><td data-v="0.445" class="dim">0.445</td><td data-v="0.796" class="dim">0.796</td><td data-v="0.78546656" class="dim">0.785</td><td data-v="0.37954258" class="dim">0.380</td><td data-v="3.3217229090909095" class="dim">$3.32</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.468"><div class="cellbar"><i style="width:64.4px;--bar:var(--c4s-b)"></i><b>0.468</b></div></td><td data-v="0.389" class="dim">0.389</td><td data-v="0.786" class="dim">0.786</td><td data-v="0.61843384" class="dim">0.618</td><td data-v="0.39293306" class="dim">0.393</td><td data-v="4.459671546394558" class="dim">$4.46</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="org">Anthropic</span></td><td data-v="0.424"><div class="cellbar"><i style="width:58.4px;--bar:var(--c4s-b)"></i><b>0.424</b></div></td><td data-v="0.332" class="dim">0.332</td><td data-v="0.795" class="dim">0.795</td><td data-v="0.53523332" class="dim">0.535</td><td data-v="0.36890528000000006" class="dim">0.369</td><td data-v="3.0888859328063245" class="dim">$3.09</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="org">OpenAI</span></td><td data-v="0.393"><div class="cellbar"><i style="width:54.1px;--bar:var(--c4s-b)"></i><b>0.393</b></div></td><td data-v="0.319" class="dim">0.319</td><td data-v="0.689" class="dim">0.689</td><td data-v="0.49742972" class="dim">0.497</td><td data-v="0.34072354" class="dim">0.341</td><td data-v="1.8773877185185188" class="dim">$1.88</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.358"><div class="cellbar"><i style="width:49.3px;--bar:var(--c4s-b)"></i><b>0.358</b></div></td><td data-v="0.246" class="dim">0.246</td><td data-v="0.807" class="dim">0.807</td><td data-v="0.63253332" class="dim">0.633</td><td data-v="0.22105694" class="dim">0.221</td><td data-v="0.07172788461538461" class="dim">$0.07</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.32"><div class="cellbar"><i style="width:44.1px;--bar:var(--c4s-b)"></i><b>0.320</b></div></td><td data-v="0.188" class="dim">0.188</td><td data-v="0.848" class="dim">0.848</td><td data-v="0.46533411999999996" class="dim">0.465</td><td data-v="0.24731454" class="dim">0.247</td><td data-v="0.09209057222222222" class="dim">$0.09</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.226"><div class="cellbar"><i style="width:31.1px;--bar:var(--c4s-b)"></i><b>0.226</b></div></td><td data-v="0.118" class="dim">0.118</td><td data-v="0.66" class="dim">0.660</td><td data-v="0.29651112" class="dim">0.297</td><td data-v="0.19101142" class="dim">0.191</td><td data-v="0.2605628115151515" class="dim">$0.26</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">DeepSeek</span></td><td data-v="0.21"><div class="cellbar"><i style="width:28.9px;--bar:var(--c4s-b)"></i><b>0.210</b></div></td><td data-v="0.066" class="dim">0.066</td><td data-v="0.787" class="dim">0.787</td><td data-v="0.18933412" class="dim">0.189</td><td data-v="0.22106668" class="dim">0.221</td><td data-v="0.054194520202020195" class="dim">$0.05</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.2"><div class="cellbar"><i style="width:27.5px;--bar:var(--c4s-b)"></i><b>0.200</b></div></td><td data-v="0.083" class="dim">0.083</td><td data-v="0.667" class="dim">0.667</td><td data-v="0.26629816" class="dim">0.266</td><td data-v="0.166406" class="dim">0.166</td><td data-v="0.27672816366207137" class="dim">$0.28</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg>
</span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.198"><div class="cellbar"><i style="width:27.3px;--bar:var(--c4s-b)"></i><b>0.198</b></div></td><td data-v="0.095" class="dim">0.095</td><td data-v="0.609" class="dim">0.609</td><td data-v="0.1690288" class="dim">0.169</td><td data-v="0.21251522" class="dim">0.213</td><td data-v="0.7541276882539681" class="dim">$0.75</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.184"><div class="cellbar"><i style="width:25.3px;--bar:var(--c4s-b)"></i><b>0.184</b></div></td><td data-v="0.044" class="dim">0.044</td><td data-v="0.744" class="dim">0.744</td><td data-v="0.1968008" class="dim">0.197</td><td data-v="0.17780978" class="dim">0.178</td><td data-v="0.2634673259259259" class="dim">$0.26</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-41)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-41" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.126"><div class="cellbar"><i style="width:17.3px;--bar:var(--c4s-b)"></i><b>0.126</b></div></td><td data-v="0.003" class="dim">0.003</td><td data-v="0.615" class="dim">0.615</td><td data-v="0.12704028" class="dim">0.127</td><td data-v="0.1247901" class="dim">0.125</td><td data-v="0.028434150793650796" class="dim">$0.03</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-42)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-42" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.115"><div class="cellbar"><i style="width:15.8px;--bar:var(--c4s-b)"></i><b>0.115</b></div></td><td data-v="0.001" class="dim">0.001</td><td data-v="0.572" class="dim">0.572</td><td data-v="0.11239600000000001" class="dim">0.112</td><td data-v="0.11635892" class="dim">0.116</td><td data-v="0.01913622993197279" class="dim">$0.02</td></tr></tbody></table></div></div>
<p class="board-note">Click a column to sort. Pareto: on the score-against-cost frontier.</p></div></div>
</div></section><section class="alt" id="takeaways"><div class="container">
<div class="section-header centered"><span class="section-label">Findings</span><h2 class="section-title">Takeaways</h2>
<p class="section-desc">What the evaluation shows across the 14 agents. Every chart below is drawn from the paper's numbers; hover for values.</p></div>
<div class="tk"><span class="n">Takeaway 1</span><h3>Construction and editing probe different capabilities: scene-level spatial reasoning and precise control of scene state.</h3><p class="s">Despite nearly identical overall scores, Astra is stronger at construction and Gemini at editing.</p><div class="figs"><figure><div class="ch-legend"><span><i style="background:var(--c4s-a)"></i>Text-to-Scene (construction)</span><span><i style="background:var(--c4s-b)"></i>Image-to-Scene (editing)</span></div><svg class="ch" viewBox="0 0 880 416" role="img" aria-label="Text-to-Scene and Image-to-Scene score per agent"><text x="290.0" y="16.0" text-anchor="end" class="b" >← Text-to-Scene</text><text x="590.0" y="16.0" text-anchor="start" class="b" >Image-to-Scene →</text><g class="row" data-tip="GPT-6 Astra (max): Text-to-Scene 0.724 · Image-to-Scene 0.515 · overall 0.619"><rect x="72.8" y="35" width="217.2" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="35" width="154.5" height="17" rx="3" fill="var(--c4s-b)"/><text x="66.8" y="47.5" text-anchor="end" class="num b" >0.724</text><text x="750.5" y="47.5" text-anchor="start" class="num b" >0.515</text><text x="440.0" y="47.5" text-anchor="middle" class="b" >GPT-6 Astra</text></g><g class="row" data-tip="Gemini 3.8 Flash (high): Text-to-Scene 0.657 · Image-to-Scene 0.581 · overall 0.619"><rect x="92.9" y="62" width="197.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="62" width="174.3" height="17" rx="3" fill="var(--c4s-b)"/><text x="86.9" y="74.5" text-anchor="end" class="num b" >0.657</text><text x="770.3" y="74.5" text-anchor="start" class="num b" >0.581</text><text x="440.0" y="74.5" text-anchor="middle" class="b" >Gemini 3.8 Flash</text></g><g class="row dim" data-tip="Claude Fable 5.1 (max): Text-to-Scene 0.788 · Image-to-Scene 0.424 · overall 0.606"><rect x="53.6" y="89" width="236.4" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="89" width="127.2" height="17" rx="3" fill="var(--c4s-b)"/><text x="47.6" y="101.5" text-anchor="end" class="num" >0.788</text><text x="723.2" y="101.5" text-anchor="start" class="num" >0.424</text><text x="440.0" y="101.5" text-anchor="middle" class="" >Claude Fable 5.1</text></g><g class="row dim" data-tip="Claude Opus 5 (max): Text-to-Scene 0.718 · Image-to-Scene 0.468 · overall 0.593"><rect x="74.6" y="116" width="215.4" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="116" width="140.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="68.6" y="128.5" text-anchor="end" class="num" >0.718</text><text x="736.4" y="128.5" text-anchor="start" class="num" >0.468</text><text x="440.0" y="128.5" text-anchor="middle" class="" >Claude Opus 5</text></g><g class="row dim" data-tip="GPT-5.6 Sol (high): Text-to-Scene 0.707 · Image-to-Scene 0.393 · overall 0.550"><rect x="77.9" y="143" width="212.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="143" width="117.9" height="17" rx="3" fill="var(--c4s-b)"/><text x="71.9" y="155.5" text-anchor="end" class="num" >0.707</text><text x="713.9" y="155.5" text-anchor="start" class="num" >0.393</text><text x="440.0" y="155.5" text-anchor="middle" class="" >GPT-5.6 Sol</text></g><g class="row dim" data-tip="Muse Spark 1.3 (medium): Text-to-Scene 0.646 · Image-to-Scene 0.358 · overall 0.502"><rect x="96.2" y="170" width="193.8" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="170" width="107.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="90.2" y="182.5" text-anchor="end" class="num" >0.646</text><text x="703.4" y="182.5" text-anchor="start" class="num" >0.358</text><text x="440.0" y="182.5" text-anchor="middle" class="" >Muse Spark 1.3</text></g><g class="row dim" data-tip="GLM-5.3 Flash (max): Text-to-Scene 0.509 · Image-to-Scene 0.320 · overall 0.415"><rect x="137.3" y="197" width="152.7" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="197" width="96.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="131.3" y="209.5" text-anchor="end" class="num" >0.509</text><text x="692.0" y="209.5" text-anchor="start" class="num" >0.320</text><text x="440.0" y="209.5" text-anchor="middle" class="" >GLM-5.3 Flash</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking off): Text-to-Scene 0.557 · Image-to-Scene 0.200 · overall 0.378"><rect x="122.9" y="224" width="167.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="224" width="60.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="116.9" y="236.5" text-anchor="end" class="num" >0.557</text><text x="656.0" y="236.5" text-anchor="start" class="num" >0.200</text><text x="440.0" y="236.5" text-anchor="middle" class="" >Qwen 3.8 27B · off</text></g><g class="row dim" data-tip="Grok 4.6 (high): Text-to-Scene 0.567 · Image-to-Scene 0.184 · overall 0.376"><rect x="119.9" y="251" width="170.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="251" width="55.2" height="17" rx="3" fill="var(--c4s-b)"/><text x="113.9" y="263.5" text-anchor="end" class="num" >0.567</text><text x="651.2" y="263.5" text-anchor="start" class="num" >0.184</text><text x="440.0" y="263.5" text-anchor="middle" class="" >Grok 4.6</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking on): Text-to-Scene 0.516 · Image-to-Scene 0.226 · overall 0.371"><rect x="135.2" y="278" width="154.8" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="278" width="67.8" height="17" rx="3" fill="var(--c4s-b)"/><text x="129.2" y="290.5" text-anchor="end" class="num" >0.516</text><text x="663.8" y="290.5" text-anchor="start" class="num" >0.226</text><text x="440.0" y="290.5" text-anchor="middle" class="" >Qwen 3.8 27B · on</text></g><g class="row dim" data-tip="Inkling (high): Text-to-Scene 0.425 · Image-to-Scene 0.198 · overall 0.312"><rect x="162.5" y="305" width="127.5" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="305" width="59.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="156.5" y="317.5" text-anchor="end" class="num" >0.425</text><text x="655.4" y="317.5" text-anchor="start" class="num" >0.198</text><text x="440.0" y="317.5" text-anchor="middle" class="" >Inkling</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking on): Text-to-Scene 0.471 · Image-to-Scene 0.126 · overall 0.298"><rect x="148.7" y="332" width="141.3" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="332" width="37.8" height="17" rx="3" fill="var(--c4s-b)"/><text x="142.7" y="344.5" text-anchor="end" class="num" >0.471</text><text x="633.8" y="344.5" text-anchor="start" class="num" >0.126</text><text x="440.0" y="344.5" text-anchor="middle" class="" >Gemma 4 31B · on</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking off): Text-to-Scene 0.455 · Image-to-Scene 0.115 · overall 0.285"><rect x="153.5" y="359" width="136.5" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="359" width="34.5" height="17" rx="3" fill="var(--c4s-b)"/><text x="147.5" y="371.5" text-anchor="end" class="num" >0.455</text><text x="630.5" y="371.5" text-anchor="start" class="num" >0.115</text><text x="440.0" y="371.5" text-anchor="middle" class="" >Gemma 4 31B · off</text></g><g class="row dim" data-tip="DeepSeek V4.1 Flash (high): Text-to-Scene 0.243 · Image-to-Scene 0.210 · overall 0.227"><rect x="217.1" y="386" width="72.9" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="386" width="63.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="211.1" y="398.5" text-anchor="end" class="num" >0.243</text><text x="659.0" y="398.5" text-anchor="start" class="num" >0.210</text><text x="440.0" y="398.5" text-anchor="middle" class="" >DeepSeek V4.1 Flash</text></g></svg><figcaption>Text-to-Scene (left) and Image-to-Scene (right) score per agent, in overall order (paper Table 2). Astra and Gemini tie at 0.619 overall.</figcaption></figure></div></div><div class="tk"><span class="n">Takeaway 2</span><h3>Spatial Composition remains the weakest requirement family for all 14 agents.</h3><p class="s">Errors persist even when the required objects are present: generating the right objects does not ensure that their relationships satisfy the specification.</p><div class="figs"><figure><div class="fh">Requirement-family score per agent</div><div class="ch-legend"><span><i style="background:var(--c4s-g1)"></i>Identity & Environment</span><span><i style="background:var(--c4s-g2)"></i>Content & Quantity</span><span><i style="background:var(--c4s-g3)"></i>Attributes & Materials</span><span><i style="background:var(--c4s-hot)"></i>Spatial Composition</span></div><svg class="ch" viewBox="0 0 880 450" role="img" aria-label="Requirement-family scores per agent"><line class="grid" x1="245.6" x2="245.6" y1="18" y2="416"/><text x="245.6" y="432.0" text-anchor="middle" class="m num" >0.2</text><line class="grid" x1="396.7" x2="396.7" y1="18" y2="416"/><text x="396.7" y="432.0" text-anchor="middle" class="m num" >0.4</text><line class="grid" x1="547.8" x2="547.8" y1="18" y2="416"/><text x="547.8" y="432.0" text-anchor="middle" class="m num" >0.6</text><line class="grid" x1="698.9" x2="698.9" y1="18" y2="416"/><text x="698.9" y="432.0" text-anchor="middle" class="m num" >0.8</text><line class="grid" x1="850.0" x2="850.0" y1="18" y2="416"/><text x="850.0" y="432.0" text-anchor="middle" class="m num" >1.0</text><g class="row" data-tip="GPT-6 Astra: Identity & Environment 0.875 · Content & Quantity 0.715 · Spatial Composition 0.543 · Attributes & Materials 0.643"><text x="158.0" y="43.0" text-anchor="end" class="" >GPT-6 Astra</text><line x1="504.7" x2="755.6" y1="39.0" y2="39.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="755.6" cy="39.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="634.7" cy="39.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="580.3" cy="39.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="504.7" cy="39.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemini 3.8 Flash: Identity & Environment 0.814 · Content & Quantity 0.639 · Spatial Composition 0.473 · Attributes & Materials 0.572"><text x="158.0" y="69.0" text-anchor="end" class="" >Gemini 3.8 Flash</text><line x1="451.8" x2="709.5" y1="65.0" y2="65.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="709.5" cy="65.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="577.2" cy="65.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="526.6" cy="65.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="451.8" cy="65.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Claude Fable 5.1: Identity & Environment 0.906 · Content & Quantity 0.738 · Spatial Composition 0.538 · Attributes & Materials 0.670"><text x="158.0" y="95.0" text-anchor="end" class="" >Claude Fable 5.1</text><line x1="500.9" x2="779.0" y1="91.0" y2="91.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="779.0" cy="91.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="652.0" cy="91.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="600.7" cy="91.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="500.9" cy="91.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Claude Opus 5: Identity & Environment 0.803 · Content & Quantity 0.624 · Spatial Composition 0.479 · Attributes & Materials 0.573"><text x="158.0" y="121.0" text-anchor="end" class="" >Claude Opus 5</text><line x1="456.4" x2="701.2" y1="117.0" y2="117.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="701.2" cy="117.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="565.9" cy="117.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="527.4" cy="117.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="456.4" cy="117.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="GPT-5.6 Sol: Identity & Environment 0.750 · Content & Quantity 0.660 · Spatial Composition 0.469 · Attributes & Materials 0.602"><text x="158.0" y="147.0" text-anchor="end" class="" >GPT-5.6 Sol</text><line x1="448.8" x2="661.1" y1="143.0" y2="143.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="661.1" cy="143.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="593.1" cy="143.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="549.3" cy="143.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="448.8" cy="143.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Muse Spark 1.3: Identity & Environment 0.730 · Content & Quantity 0.641 · Spatial Composition 0.393 · Attributes & Materials 0.546"><text x="158.0" y="173.0" text-anchor="end" class="" >Muse Spark 1.3</text><line x1="391.4" x2="646.0" y1="169.0" y2="169.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="646.0" cy="169.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="578.8" cy="169.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="507.0" cy="169.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="391.4" cy="169.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="GLM-5.3 Flash: Identity & Environment 0.467 · Content & Quantity 0.421 · Spatial Composition 0.299 · Attributes & Materials 0.377"><text x="158.0" y="199.0" text-anchor="end" class="" >GLM-5.3 Flash</text><line x1="320.4" x2="447.3" y1="195.0" y2="195.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="447.3" cy="195.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="412.5" cy="195.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="379.3" cy="195.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="320.4" cy="195.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Qwen 3.8 27B · off: Identity & Environment 0.724 · Content & Quantity 0.520 · Spatial Composition 0.300 · Attributes & Materials 0.428"><text x="158.0" y="225.0" text-anchor="end" class="" >Qwen 3.8 27B · off</text><line x1="321.1" x2="641.5" y1="221.0" y2="221.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="641.5" cy="221.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="487.3" cy="221.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="417.8" cy="221.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="321.1" cy="221.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Grok 4.6: Identity & Environment 0.647 · Content & Quantity 0.558 · Spatial Composition 0.334 · Attributes & Materials 0.457"><text x="158.0" y="251.0" text-anchor="end" class="" >Grok 4.6</text><line x1="346.8" x2="583.3" y1="247.0" y2="247.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="583.3" cy="247.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="516.0" cy="247.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="439.7" cy="247.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="346.8" cy="247.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Qwen 3.8 27B · on: Identity & Environment 0.660 · Content & Quantity 0.525 · Spatial Composition 0.307 · Attributes & Materials 0.470"><text x="158.0" y="277.0" text-anchor="end" class="" >Qwen 3.8 27B · on</text><line x1="326.4" x2="593.1" y1="273.0" y2="273.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="593.1" cy="273.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="491.1" cy="273.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="449.6" cy="273.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="326.4" cy="273.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Inkling: Identity & Environment 0.572 · Content & Quantity 0.394 · Spatial Composition 0.193 · Attributes & Materials 0.361"><text x="158.0" y="303.0" text-anchor="end" class="" >Inkling</text><line x1="240.3" x2="526.6" y1="299.0" y2="299.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="526.6" cy="299.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="392.1" cy="299.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="367.2" cy="299.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="240.3" cy="299.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemma 4 31B · on: Identity & Environment 0.561 · Content & Quantity 0.407 · Spatial Composition 0.272 · Attributes & Materials 0.387"><text x="158.0" y="329.0" text-anchor="end" class="" >Gemma 4 31B · on</text><line x1="300.0" x2="518.3" y1="325.0" y2="325.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="518.3" cy="325.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="402.0" cy="325.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="386.8" cy="325.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="300.0" cy="325.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemma 4 31B · off: Identity & Environment 0.612 · Content & Quantity 0.453 · Spatial Composition 0.252 · Attributes & Materials 0.387"><text x="158.0" y="355.0" text-anchor="end" class="" >Gemma 4 31B · off</text><line x1="284.8" x2="556.8" y1="351.0" y2="351.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="556.8" cy="351.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="436.7" cy="351.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="386.8" cy="351.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="284.8" cy="351.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="DeepSeek V4.1 Flash: Identity & Environment 0.294 · Content & Quantity 0.215 · Spatial Composition 0.120 · Attributes & Materials 0.259"><text x="158.0" y="381.0" text-anchor="end" class="" >DeepSeek V4.1 Flash</text><line x1="185.1" x2="316.6" y1="377.0" y2="377.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="316.6" cy="377.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="256.9" cy="377.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="290.1" cy="377.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="185.1" cy="377.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><line class="axis" x1="10" x2="850" y1="390.0" y2="390.0"/><g class="row" data-tip="Mean of the 14 agents: Identity & Environment 0.672 · Content & Quantity 0.536 · Spatial Composition 0.355 · Attributes & Materials 0.481"><text x="158.0" y="407.0" text-anchor="end" class="b" >Mean of 14</text><line x1="362.8" x2="602.6" y1="403.0" y2="403.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="602.6" cy="403.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="499.7" cy="403.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="457.8" cy="403.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="362.8" cy="403.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/><text x="351.8" y="407.0" text-anchor="end" class="hot num" >0.36</text><text x="613.6" y="407.0" text-anchor="start" class="m num" >0.67</text></g></svg><figcaption>Each row is one agent's four family scores; the orange dot, Spatial Composition, is the lowest in every row (paper Figure 14b).</figcaption></figure><div class="figs two" style="margin-top:0"><figure><div class="fh">The objects are there; the relation is not</div><div class="ev"><img src="img/judge_egyptian-temple_sol_s3f_000025.jpg?v=1790731787" loading="lazy" alt="The judge's view of GPT-5.6 Sol's Egyptian Temple roof"><svg viewBox="0 0 1280 720" preserveAspectRatio="none" aria-hidden="true"><circle cx="848" cy="335" r="60" fill="none" stroke="#000" stroke-opacity=".55" stroke-width="11"/><circle cx="848" cy="335" r="60" fill="none" stroke="#ff6b4a" stroke-width="6"/><circle cx="626" cy="30" r="44" fill="none" stroke="#000" stroke-opacity=".55" stroke-width="11"/><circle cx="626" cy="30" r="44" fill="none" stroke="#ff6b4a" stroke-width="6"/></svg></div><div class="chips"><span class="chip ok">✓ slab roof <small>0.95</small></span><span class="chip ok">✓ stone coping <small>0.82</small></span><span class="chip no">✗ slab roof enclosed by the coping <small>0.78</small></span></div><figcaption>The judge's own frame of GPT-5.6 Sol on Egyptian Temple. It finds the slab roof and the stone coping, but not the roof enclosed by the coping: the coping is separate low wall segments with visible gaps (ringed).</figcaption></figure><figure><div class="fh">Mismatch rate when the required objects are present</div><svg class="ch" viewBox="0 0 440 144" role="img" aria-label="Mismatch rate when the required objects are present"><g data-tip="Spatial relation: 32.0% of checks fail although the objects are present"><text x="120.0" y="34.0" text-anchor="end" class="b" >Spatial relation</text><rect x="130" y="16" width="228.6" height="28" rx="4" fill="var(--c4s-hot)"/><text x="366.6" y="35.0" text-anchor="start" class="num hot" >32.0%</text></g><g data-tip="Distribution: 19.1% of checks fail although the objects are present"><text x="120.0" y="78.0" text-anchor="end" class="" >Distribution</text><rect x="130" y="60" width="136.4" height="28" rx="4" fill="var(--c4s-g1)"/><text x="274.4" y="79.0" text-anchor="start" class="num b" >19.1%</text></g><g data-tip="Composition: 4.3% of checks fail although the objects are present"><text x="120.0" y="122.0" text-anchor="end" class="" >Composition</text><rect x="130" y="104" width="30.7" height="28" rx="4" fill="var(--c4s-g1)"/><text x="168.7" y="123.0" text-anchor="start" class="num b" >4.3%</text></g></svg><figcaption>Across the benchmark (paper Figure 6a).</figcaption></figure></div></div></div><div class="tk"><span class="n">Takeaway 3</span><h3>Editing ability varies substantially across repair types.</h3><p class="s">Astra performs best on Transform repairs, while Gemini is stronger on Lifecycle and Layout operations.</p><div class="figs"><figure><svg class="ch" viewBox="0 0 720 298" role="img" aria-label="Mean Image-to-Scene score by repair type"><text x="184.0" y="20.0" text-anchor="middle" class="b" >GPT-6 Astra</text><text x="338.0" y="20.0" text-anchor="middle" class="b" >Gemini 3.8 Flash</text><text x="492.0" y="20.0" text-anchor="middle" class="b" >Claude Fable 5.1</text><text x="646.0" y="20.0" text-anchor="middle" class="b" >Claude Opus 5</text><text x="98.0" y="62.0" text-anchor="end" class="b" >Restore</text><g data-tip="Restore · GPT-6 Astra: 0.324"><rect x="110" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 46%, var(--surface-1))"/><text x="184.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.324</text></g><g data-tip="Restore · Gemini 3.8 Flash: 0.376"><rect x="264" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 51%, var(--surface-1))"/><text x="338.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.376</text></g><g data-tip="Restore · Claude Fable 5.1: 0.244"><rect x="418" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 37%, var(--surface-1))"/><text x="492.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.244</text></g><g data-tip="Restore · Claude Opus 5: 0.388 (best of the four)"><rect x="572" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 53%, var(--surface-1))"/><rect x="574" y="36" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="646.0" y="62.0" text-anchor="middle" class="num" style="font-weight:800;fill:var(--text-primary);font-size:15px">0.388</text></g><text x="98.0" y="114.0" text-anchor="end" class="b" >Lifecycle</text><g data-tip="Lifecycle · GPT-6 Astra: 0.577"><rect x="110" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 73%, var(--surface-1))"/><text x="184.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.577</text></g><g data-tip="Lifecycle · Gemini 3.8 Flash: 0.715 (best of the four)"><rect x="264" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 89%, var(--surface-1))"/><rect x="266" y="88" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="338.0" y="114.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.715</text></g><g data-tip="Lifecycle · Claude Fable 5.1: 0.554"><rect x="418" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))"/><text x="492.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.554</text></g><g data-tip="Lifecycle · Claude Opus 5: 0.593"><rect x="572" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 75%, var(--surface-1))"/><text x="646.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.593</text></g><text x="98.0" y="166.0" text-anchor="end" class="b" >Layout</text><g data-tip="Layout · GPT-6 Astra: 0.596"><rect x="110" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 76%, var(--surface-1))"/><text x="184.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.596</text></g><g data-tip="Layout · Gemini 3.8 Flash: 0.703 (best of the four)"><rect x="264" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 87%, var(--surface-1))"/><rect x="266" y="140" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="338.0" y="166.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.703</text></g><g data-tip="Layout · Claude Fable 5.1: 0.464"><rect x="418" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))"/><text x="492.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.464</text></g><g data-tip="Layout · Claude Opus 5: 0.512"><rect x="572" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 66%, var(--surface-1))"/><text x="646.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.512</text></g><text x="98.0" y="218.0" text-anchor="end" class="b" >Symmetry</text><g data-tip="Symmetry · GPT-6 Astra: 0.466"><rect x="110" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))"/><text x="184.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.466</text></g><g data-tip="Symmetry · Gemini 3.8 Flash: 0.544"><rect x="264" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 70%, var(--surface-1))"/><text x="338.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.544</text></g><g data-tip="Symmetry · Claude Fable 5.1: 0.555 (best of the four)"><rect x="418" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))"/><rect x="420" y="192" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="492.0" y="218.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.555</text></g><g data-tip="Symmetry · Claude Opus 5: 0.359"><rect x="572" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))"/><text x="646.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.359</text></g><text x="98.0" y="270.0" text-anchor="end" class="b" >Transform</text><g data-tip="Transform · GPT-6 Astra: 0.613 (best of the four)"><rect x="110" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 77%, var(--surface-1))"/><rect x="112" y="244" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="184.0" y="270.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.613</text></g><g data-tip="Transform · Gemini 3.8 Flash: 0.532"><rect x="264" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 69%, var(--surface-1))"/><text x="338.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.532</text></g><g data-tip="Transform · Claude Fable 5.1: 0.353"><rect x="418" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))"/><text x="492.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.353</text></g><g data-tip="Transform · Claude Opus 5: 0.406"><rect x="572" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 55%, var(--surface-1))"/><text x="646.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.406</text></g></svg><figcaption>Mean Image-to-Scene score by repair type for four agents; the outlined cell is the best of the four in its row (paper Figure 6b).</figcaption></figure></div></div><div class="tk"><span class="n">Takeaway 4</span><h3>Recovering the target does not guarantee precise editing.</h3><p class="s">Across all 14 configurations, 35.8% of complete recoveries still contain unintended changes to the surrounding scene.</p><div class="figs"><figure><div class="bigstats"><div><b>1,050</b><span>Image-to-Scene evaluations (14 agents × 75 cases)</span></div><div><b style="color:var(--c4s-ok)">212</b><span>recovered every target completely</span></div><div><b style="color:var(--c4s-hot)">76 · 35.8%</b><span>of those still changed the surrounding scene</span></div></div><div class="ch-legend"><span><i style="background:var(--c4s-hot)"></i>unintended edits</span><span><i style="background:var(--c4s-ok)"></i>clean complete recovery</span><span><i style="background:var(--c4s-unit)"></i>no complete recovery</span></div><svg class="ch" viewBox="0 0 850 357" role="img" aria-label="1,050 evaluations, 212 complete recoveries, 76 with unintended edits"><g fill="var(--c4s-unit)" data-tip="838 evaluations without complete recovery"><circle cx="178.5" cy="42.5" r="6.2"/><circle cx="178.5" cy="59.5" r="6.2"/><circle cx="178.5" cy="76.5" r="6.2"/><circle cx="178.5" cy="93.5" r="6.2"/><circle cx="178.5" cy="110.5" r="6.2"/><circle cx="178.5" cy="127.5" r="6.2"/><circle cx="178.5" cy="144.5" r="6.2"/><circle cx="178.5" cy="161.5" r="6.2"/><circle cx="178.5" cy="178.5" r="6.2"/><circle cx="178.5" cy="195.5" r="6.2"/><circle cx="178.5" cy="212.5" r="6.2"/><circle cx="178.5" cy="229.5" r="6.2"/><circle cx="178.5" cy="246.5" r="6.2"/><circle cx="178.5" cy="263.5" r="6.2"/><circle cx="178.5" cy="280.5" r="6.2"/><circle cx="178.5" cy="297.5" r="6.2"/><circle cx="178.5" cy="314.5" r="6.2"/><circle cx="178.5" cy="331.5" r="6.2"/><circle cx="178.5" cy="348.5" r="6.2"/><circle cx="195.5" cy="8.5" r="6.2"/><circle cx="195.5" cy="25.5" r="6.2"/><circle cx="195.5" cy="42.5" r="6.2"/><circle cx="195.5" cy="59.5" r="6.2"/><circle cx="195.5" cy="76.5" r="6.2"/><circle cx="195.5" cy="93.5" r="6.2"/><circle cx="195.5" cy="110.5" r="6.2"/><circle cx="195.5" cy="127.5" r="6.2"/><circle cx="195.5" cy="144.5" r="6.2"/><circle cx="195.5" cy="161.5" r="6.2"/><circle cx="195.5" cy="178.5" r="6.2"/><circle cx="195.5" cy="195.5" r="6.2"/><circle cx="195.5" cy="212.5" r="6.2"/><circle cx="195.5" cy="229.5" r="6.2"/><circle cx="195.5" cy="246.5" r="6.2"/><circle cx="195.5" cy="263.5" r="6.2"/><circle cx="195.5" cy="280.5" r="6.2"/><circle cx="195.5" cy="297.5" r="6.2"/><circle cx="195.5" cy="314.5" r="6.2"/><circle cx="195.5" cy="331.5" r="6.2"/><circle cx="195.5" cy="348.5" r="6.2"/><circle cx="212.5" cy="8.5" r="6.2"/><circle cx="212.5" cy="25.5" r="6.2"/><circle cx="212.5" cy="42.5" r="6.2"/><circle cx="212.5" cy="59.5" r="6.2"/><circle cx="212.5" cy="76.5" r="6.2"/><circle cx="212.5" cy="93.5" r="6.2"/><circle cx="212.5" cy="110.5" r="6.2"/><circle cx="212.5" cy="127.5" r="6.2"/><circle cx="212.5" cy="144.5" r="6.2"/><circle cx="212.5" cy="161.5" r="6.2"/><circle cx="212.5" cy="178.5" r="6.2"/><circle cx="212.5" cy="195.5" r="6.2"/><circle cx="212.5" cy="212.5" r="6.2"/><circle cx="212.5" cy="229.5" r="6.2"/><circle cx="212.5" cy="246.5" r="6.2"/><circle cx="212.5" cy="263.5" r="6.2"/><circle cx="212.5" cy="280.5" r="6.2"/><circle cx="212.5" cy="297.5" r="6.2"/><circle cx="212.5" cy="314.5" r="6.2"/><circle cx="212.5" cy="331.5" r="6.2"/><circle cx="212.5" cy="348.5" r="6.2"/><circle cx="229.5" cy="8.5" r="6.2"/><circle cx="229.5" cy="25.5" r="6.2"/><circle cx="229.5" cy="42.5" r="6.2"/><circle cx="229.5" cy="59.5" r="6.2"/><circle cx="229.5" cy="76.5" r="6.2"/><circle cx="229.5" cy="93.5" r="6.2"/><circle cx="229.5" cy="110.5" r="6.2"/><circle cx="229.5" cy="127.5" r="6.2"/><circle cx="229.5" cy="144.5" r="6.2"/><circle cx="229.5" cy="161.5" r="6.2"/><circle cx="229.5" cy="178.5" r="6.2"/><circle cx="229.5" cy="195.5" r="6.2"/><circle cx="229.5" cy="212.5" r="6.2"/><circle cx="229.5" cy="229.5" r="6.2"/><circle cx="229.5" cy="246.5" r="6.2"/><circle cx="229.5" cy="263.5" r="6.2"/><circle cx="229.5" cy="280.5" r="6.2"/><circle cx="229.5" cy="297.5" r="6.2"/><circle cx="229.5" cy="314.5" r="6.2"/><circle cx="229.5" cy="331.5" r="6.2"/><circle cx="229.5" cy="348.5" r="6.2"/><circle cx="246.5" cy="8.5" r="6.2"/><circle cx="246.5" cy="25.5" r="6.2"/><circle cx="246.5" cy="42.5" r="6.2"/><circle cx="246.5" cy="59.5" r="6.2"/><circle cx="246.5" cy="76.5" r="6.2"/><circle cx="246.5" cy="93.5" r="6.2"/><circle cx="246.5" cy="110.5" r="6.2"/><circle cx="246.5" cy="127.5" r="6.2"/><circle cx="246.5" cy="144.5" r="6.2"/><circle cx="246.5" cy="161.5" r="6.2"/><circle cx="246.5" cy="178.5" r="6.2"/><circle cx="246.5" cy="195.5" r="6.2"/><circle cx="246.5" cy="212.5" r="6.2"/><circle cx="246.5" cy="229.5" r="6.2"/><circle cx="246.5" cy="246.5" r="6.2"/><circle cx="246.5" cy="263.5" r="6.2"/><circle cx="246.5" cy="280.5" r="6.2"/><circle cx="246.5" cy="297.5" r="6.2"/><circle cx="246.5" cy="314.5" r="6.2"/><circle cx="246.5" cy="331.5" r="6.2"/><circle cx="246.5" cy="348.5" r="6.2"/><circle cx="263.5" cy="8.5" r="6.2"/><circle cx="263.5" cy="25.5" r="6.2"/><circle cx="263.5" cy="42.5" r="6.2"/><circle cx="263.5" cy="59.5" r="6.2"/><circle cx="263.5" cy="76.5" r="6.2"/><circle cx="263.5" cy="93.5" r="6.2"/><circle cx="263.5" cy="110.5" r="6.2"/><circle cx="263.5" cy="127.5" r="6.2"/><circle cx="263.5" cy="144.5" r="6.2"/><circle cx="263.5" cy="161.5" r="6.2"/><circle cx="263.5" cy="178.5" r="6.2"/><circle cx="263.5" cy="195.5" r="6.2"/><circle cx="263.5" cy="212.5" r="6.2"/><circle cx="263.5" cy="229.5" r="6.2"/><circle cx="263.5" cy="246.5" r="6.2"/><circle cx="263.5" cy="263.5" r="6.2"/><circle cx="263.5" cy="280.5" r="6.2"/><circle cx="263.5" cy="297.5" r="6.2"/><circle cx="263.5" cy="314.5" r="6.2"/><circle cx="263.5" cy="331.5" r="6.2"/><circle cx="263.5" cy="348.5" r="6.2"/><circle cx="280.5" cy="8.5" r="6.2"/><circle cx="280.5" cy="25.5" r="6.2"/><circle cx="280.5" cy="42.5" r="6.2"/><circle cx="280.5" cy="59.5" r="6.2"/><circle cx="280.5" cy="76.5" r="6.2"/><circle cx="280.5" cy="93.5" r="6.2"/><circle cx="280.5" cy="110.5" r="6.2"/><circle cx="280.5" cy="127.5" r="6.2"/><circle cx="280.5" cy="144.5" r="6.2"/><circle cx="280.5" cy="161.5" r="6.2"/><circle cx="280.5" cy="178.5" r="6.2"/><circle cx="280.5" cy="195.5" r="6.2"/><circle cx="280.5" cy="212.5" r="6.2"/><circle cx="280.5" cy="229.5" r="6.2"/><circle cx="280.5" cy="246.5" r="6.2"/><circle cx="280.5" cy="263.5" r="6.2"/><circle cx="280.5" cy="280.5" r="6.2"/><circle cx="280.5" cy="297.5" r="6.2"/><circle cx="280.5" cy="314.5" r="6.2"/><circle cx="280.5" cy="331.5" r="6.2"/><circle cx="280.5" cy="348.5" r="6.2"/><circle cx="297.5" cy="8.5" r="6.2"/><circle cx="297.5" cy="25.5" r="6.2"/><circle cx="297.5" cy="42.5" r="6.2"/><circle cx="297.5" cy="59.5" r="6.2"/><circle cx="297.5" cy="76.5" r="6.2"/><circle cx="297.5" cy="93.5" r="6.2"/><circle cx="297.5" cy="110.5" r="6.2"/><circle cx="297.5" cy="127.5" r="6.2"/><circle cx="297.5" cy="144.5" r="6.2"/><circle cx="297.5" cy="161.5" r="6.2"/><circle cx="297.5" cy="178.5" r="6.2"/><circle cx="297.5" cy="195.5" r="6.2"/><circle cx="297.5" cy="212.5" r="6.2"/><circle cx="297.5" cy="229.5" r="6.2"/><circle cx="297.5" cy="246.5" r="6.2"/><circle cx="297.5" cy="263.5" r="6.2"/><circle cx="297.5" cy="280.5" r="6.2"/><circle cx="297.5" cy="297.5" r="6.2"/><circle cx="297.5" cy="314.5" r="6.2"/><circle cx="297.5" cy="331.5" r="6.2"/><circle cx="297.5" cy="348.5" r="6.2"/><circle cx="314.5" cy="8.5" r="6.2"/><circle cx="314.5" cy="25.5" r="6.2"/><circle cx="314.5" cy="42.5" r="6.2"/><circle cx="314.5" cy="59.5" r="6.2"/><circle cx="314.5" cy="76.5" r="6.2"/><circle cx="314.5" cy="93.5" r="6.2"/><circle cx="314.5" cy="110.5" r="6.2"/><circle cx="314.5" cy="127.5" r="6.2"/><circle cx="314.5" cy="144.5" r="6.2"/><circle cx="314.5" cy="161.5" r="6.2"/><circle cx="314.5" cy="178.5" r="6.2"/><circle cx="314.5" cy="195.5" r="6.2"/><circle cx="314.5" cy="212.5" r="6.2"/><circle cx="314.5" cy="229.5" r="6.2"/><circle cx="314.5" cy="246.5" r="6.2"/><circle cx="314.5" cy="263.5" r="6.2"/><circle cx="314.5" cy="280.5" r="6.2"/><circle cx="314.5" cy="297.5" r="6.2"/><circle cx="314.5" cy="314.5" r="6.2"/><circle cx="314.5" cy="331.5" r="6.2"/><circle cx="314.5" cy="348.5" r="6.2"/><circle cx="331.5" cy="8.5" r="6.2"/><circle cx="331.5" cy="25.5" r="6.2"/><circle cx="331.5" cy="42.5" r="6.2"/><circle cx="331.5" cy="59.5" r="6.2"/><circle cx="331.5" cy="76.5" r="6.2"/><circle cx="331.5" cy="93.5" r="6.2"/><circle cx="331.5" cy="110.5" r="6.2"/><circle cx="331.5" cy="127.5" r="6.2"/><circle cx="331.5" cy="144.5" r="6.2"/><circle cx="331.5" cy="161.5" r="6.2"/><circle cx="331.5" cy="178.5" r="6.2"/><circle cx="331.5" cy="195.5" r="6.2"/><circle cx="331.5" cy="212.5" r="6.2"/><circle cx="331.5" cy="229.5" r="6.2"/><circle cx="331.5" cy="246.5" r="6.2"/><circle cx="331.5" cy="263.5" r="6.2"/><circle cx="331.5" cy="280.5" r="6.2"/><circle cx="331.5" cy="297.5" r="6.2"/><circle cx="331.5" cy="314.5" r="6.2"/><circle cx="331.5" cy="331.5" r="6.2"/><circle cx="331.5" cy="348.5" r="6.2"/><circle cx="348.5" cy="8.5" r="6.2"/><circle cx="348.5" cy="25.5" r="6.2"/><circle cx="348.5" cy="42.5" r="6.2"/><circle cx="348.5" cy="59.5" r="6.2"/><circle cx="348.5" cy="76.5" r="6.2"/><circle cx="348.5" cy="93.5" r="6.2"/><circle cx="348.5" cy="110.5" r="6.2"/><circle cx="348.5" cy="127.5" r="6.2"/><circle cx="348.5" cy="144.5" r="6.2"/><circle cx="348.5" cy="161.5" r="6.2"/><circle cx="348.5" cy="178.5" r="6.2"/><circle cx="348.5" cy="195.5" r="6.2"/><circle cx="348.5" cy="212.5" r="6.2"/><circle cx="348.5" cy="229.5" r="6.2"/><circle cx="348.5" cy="246.5" r="6.2"/><circle cx="348.5" cy="263.5" r="6.2"/><circle cx="348.5" cy="280.5" r="6.2"/><circle cx="348.5" cy="297.5" r="6.2"/><circle cx="348.5" cy="314.5" r="6.2"/><circle cx="348.5" cy="331.5" r="6.2"/><circle cx="348.5" cy="348.5" r="6.2"/><circle cx="365.5" cy="8.5" r="6.2"/><circle cx="365.5" cy="25.5" r="6.2"/><circle cx="365.5" cy="42.5" r="6.2"/><circle cx="365.5" cy="59.5" r="6.2"/><circle cx="365.5" cy="76.5" r="6.2"/><circle cx="365.5" cy="93.5" r="6.2"/><circle cx="365.5" cy="110.5" r="6.2"/><circle cx="365.5" cy="127.5" r="6.2"/><circle cx="365.5" cy="144.5" r="6.2"/><circle cx="365.5" cy="161.5" r="6.2"/><circle cx="365.5" cy="178.5" r="6.2"/><circle cx="365.5" cy="195.5" r="6.2"/><circle cx="365.5" cy="212.5" r="6.2"/><circle cx="365.5" cy="229.5" r="6.2"/><circle cx="365.5" cy="246.5" r="6.2"/><circle cx="365.5" cy="263.5" r="6.2"/><circle cx="365.5" cy="280.5" r="6.2"/><circle cx="365.5" cy="297.5" r="6.2"/><circle cx="365.5" cy="314.5" r="6.2"/><circle cx="365.5" cy="331.5" r="6.2"/><circle cx="365.5" cy="348.5" r="6.2"/><circle cx="382.5" cy="8.5" r="6.2"/><circle cx="382.5" cy="25.5" r="6.2"/><circle cx="382.5" cy="42.5" r="6.2"/><circle cx="382.5" cy="59.5" r="6.2"/><circle cx="382.5" cy="76.5" r="6.2"/><circle cx="382.5" cy="93.5" r="6.2"/><circle cx="382.5" cy="110.5" r="6.2"/><circle cx="382.5" cy="127.5" r="6.2"/><circle cx="382.5" cy="144.5" r="6.2"/><circle cx="382.5" cy="161.5" r="6.2"/><circle cx="382.5" cy="178.5" r="6.2"/><circle cx="382.5" cy="195.5" r="6.2"/><circle cx="382.5" cy="212.5" r="6.2"/><circle cx="382.5" cy="229.5" r="6.2"/><circle cx="382.5" cy="246.5" r="6.2"/><circle cx="382.5" cy="263.5" r="6.2"/><circle cx="382.5" cy="280.5" r="6.2"/><circle cx="382.5" cy="297.5" r="6.2"/><circle cx="382.5" cy="314.5" r="6.2"/><circle cx="382.5" cy="331.5" r="6.2"/><circle cx="382.5" cy="348.5" r="6.2"/><circle cx="399.5" cy="8.5" r="6.2"/><circle cx="399.5" cy="25.5" r="6.2"/><circle cx="399.5" cy="42.5" r="6.2"/><circle cx="399.5" cy="59.5" r="6.2"/><circle cx="399.5" cy="76.5" r="6.2"/><circle cx="399.5" cy="93.5" r="6.2"/><circle cx="399.5" cy="110.5" r="6.2"/><circle cx="399.5" cy="127.5" r="6.2"/><circle cx="399.5" cy="144.5" r="6.2"/><circle cx="399.5" cy="161.5" r="6.2"/><circle cx="399.5" cy="178.5" r="6.2"/><circle cx="399.5" cy="195.5" r="6.2"/><circle cx="399.5" cy="212.5" r="6.2"/><circle cx="399.5" cy="229.5" r="6.2"/><circle cx="399.5" cy="246.5" r="6.2"/><circle cx="399.5" cy="263.5" r="6.2"/><circle cx="399.5" cy="280.5" r="6.2"/><circle cx="399.5" cy="297.5" r="6.2"/><circle cx="399.5" cy="314.5" r="6.2"/><circle cx="399.5" cy="331.5" r="6.2"/><circle cx="399.5" cy="348.5" r="6.2"/><circle cx="416.5" cy="8.5" r="6.2"/><circle cx="416.5" cy="25.5" r="6.2"/><circle cx="416.5" cy="42.5" r="6.2"/><circle cx="416.5" cy="59.5" r="6.2"/><circle cx="416.5" cy="76.5" r="6.2"/><circle cx="416.5" cy="93.5" r="6.2"/><circle cx="416.5" cy="110.5" r="6.2"/><circle cx="416.5" cy="127.5" r="6.2"/><circle cx="416.5" cy="144.5" r="6.2"/><circle cx="416.5" cy="161.5" r="6.2"/><circle cx="416.5" cy="178.5" r="6.2"/><circle cx="416.5" cy="195.5" r="6.2"/><circle cx="416.5" cy="212.5" r="6.2"/><circle cx="416.5" cy="229.5" r="6.2"/><circle cx="416.5" cy="246.5" r="6.2"/><circle cx="416.5" cy="263.5" r="6.2"/><circle cx="416.5" cy="280.5" r="6.2"/><circle cx="416.5" cy="297.5" r="6.2"/><circle cx="416.5" cy="314.5" r="6.2"/><circle cx="416.5" cy="331.5" r="6.2"/><circle cx="416.5" cy="348.5" r="6.2"/><circle cx="433.5" cy="8.5" r="6.2"/><circle cx="433.5" cy="25.5" r="6.2"/><circle cx="433.5" cy="42.5" r="6.2"/><circle cx="433.5" cy="59.5" r="6.2"/><circle cx="433.5" cy="76.5" r="6.2"/><circle cx="433.5" cy="93.5" r="6.2"/><circle cx="433.5" cy="110.5" r="6.2"/><circle cx="433.5" cy="127.5" r="6.2"/><circle cx="433.5" cy="144.5" r="6.2"/><circle cx="433.5" cy="161.5" r="6.2"/><circle cx="433.5" cy="178.5" r="6.2"/><circle cx="433.5" cy="195.5" r="6.2"/><circle cx="433.5" cy="212.5" r="6.2"/><circle cx="433.5" cy="229.5" r="6.2"/><circle cx="433.5" cy="246.5" r="6.2"/><circle cx="433.5" cy="263.5" r="6.2"/><circle cx="433.5" cy="280.5" r="6.2"/><circle cx="433.5" cy="297.5" r="6.2"/><circle cx="433.5" cy="314.5" r="6.2"/><circle cx="433.5" cy="331.5" r="6.2"/><circle cx="433.5" cy="348.5" r="6.2"/><circle cx="450.5" cy="8.5" r="6.2"/><circle cx="450.5" cy="25.5" r="6.2"/><circle cx="450.5" cy="42.5" r="6.2"/><circle cx="450.5" cy="59.5" r="6.2"/><circle cx="450.5" cy="76.5" r="6.2"/><circle cx="450.5" cy="93.5" r="6.2"/><circle cx="450.5" cy="110.5" r="6.2"/><circle cx="450.5" cy="127.5" r="6.2"/><circle cx="450.5" cy="144.5" r="6.2"/><circle cx="450.5" cy="161.5" r="6.2"/><circle cx="450.5" cy="178.5" r="6.2"/><circle cx="450.5" cy="195.5" r="6.2"/><circle cx="450.5" cy="212.5" r="6.2"/><circle cx="450.5" cy="229.5" r="6.2"/><circle cx="450.5" cy="246.5" r="6.2"/><circle cx="450.5" cy="263.5" r="6.2"/><circle cx="450.5" cy="280.5" r="6.2"/><circle cx="450.5" cy="297.5" r="6.2"/><circle cx="450.5" cy="314.5" r="6.2"/><circle cx="450.5" cy="331.5" r="6.2"/><circle cx="450.5" cy="348.5" r="6.2"/><circle cx="467.5" cy="8.5" r="6.2"/><circle cx="467.5" cy="25.5" r="6.2"/><circle cx="467.5" cy="42.5" r="6.2"/><circle cx="467.5" cy="59.5" r="6.2"/><circle cx="467.5" cy="76.5" r="6.2"/><circle cx="467.5" cy="93.5" r="6.2"/><circle cx="467.5" cy="110.5" r="6.2"/><circle cx="467.5" cy="127.5" r="6.2"/><circle cx="467.5" cy="144.5" r="6.2"/><circle cx="467.5" cy="161.5" r="6.2"/><circle cx="467.5" cy="178.5" r="6.2"/><circle cx="467.5" cy="195.5" r="6.2"/><circle cx="467.5" cy="212.5" r="6.2"/><circle cx="467.5" cy="229.5" r="6.2"/><circle cx="467.5" cy="246.5" r="6.2"/><circle cx="467.5" cy="263.5" r="6.2"/><circle cx="467.5" cy="280.5" r="6.2"/><circle cx="467.5" cy="297.5" r="6.2"/><circle cx="467.5" cy="314.5" r="6.2"/><circle cx="467.5" cy="331.5" r="6.2"/><circle cx="467.5" cy="348.5" r="6.2"/><circle cx="484.5" cy="8.5" r="6.2"/><circle cx="484.5" cy="25.5" r="6.2"/><circle cx="484.5" cy="42.5" r="6.2"/><circle cx="484.5" cy="59.5" r="6.2"/><circle cx="484.5" cy="76.5" r="6.2"/><circle cx="484.5" cy="93.5" r="6.2"/><circle cx="484.5" cy="110.5" r="6.2"/><circle cx="484.5" cy="127.5" r="6.2"/><circle cx="484.5" cy="144.5" r="6.2"/><circle cx="484.5" cy="161.5" r="6.2"/><circle cx="484.5" cy="178.5" r="6.2"/><circle cx="484.5" cy="195.5" r="6.2"/><circle cx="484.5" cy="212.5" r="6.2"/><circle cx="484.5" cy="229.5" r="6.2"/><circle cx="484.5" cy="246.5" r="6.2"/><circle cx="484.5" cy="263.5" r="6.2"/><circle cx="484.5" cy="280.5" r="6.2"/><circle cx="484.5" cy="297.5" r="6.2"/><circle cx="484.5" cy="314.5" r="6.2"/><circle cx="484.5" cy="331.5" r="6.2"/><circle cx="484.5" cy="348.5" r="6.2"/><circle cx="501.5" cy="8.5" r="6.2"/><circle cx="501.5" cy="25.5" r="6.2"/><circle cx="501.5" cy="42.5" r="6.2"/><circle cx="501.5" cy="59.5" r="6.2"/><circle cx="501.5" cy="76.5" r="6.2"/><circle cx="501.5" cy="93.5" r="6.2"/><circle cx="501.5" cy="110.5" r="6.2"/><circle cx="501.5" cy="127.5" r="6.2"/><circle cx="501.5" cy="144.5" r="6.2"/><circle cx="501.5" cy="161.5" r="6.2"/><circle cx="501.5" cy="178.5" r="6.2"/><circle cx="501.5" cy="195.5" r="6.2"/><circle cx="501.5" cy="212.5" r="6.2"/><circle cx="501.5" cy="229.5" r="6.2"/><circle cx="501.5" cy="246.5" r="6.2"/><circle cx="501.5" cy="263.5" r="6.2"/><circle cx="501.5" cy="280.5" r="6.2"/><circle cx="501.5" cy="297.5" r="6.2"/><circle cx="501.5" cy="314.5" r="6.2"/><circle cx="501.5" cy="331.5" r="6.2"/><circle cx="501.5" cy="348.5" r="6.2"/><circle cx="518.5" cy="8.5" r="6.2"/><circle cx="518.5" cy="25.5" r="6.2"/><circle cx="518.5" cy="42.5" r="6.2"/><circle cx="518.5" cy="59.5" r="6.2"/><circle cx="518.5" cy="76.5" r="6.2"/><circle cx="518.5" cy="93.5" r="6.2"/><circle cx="518.5" cy="110.5" r="6.2"/><circle cx="518.5" cy="127.5" r="6.2"/><circle cx="518.5" cy="144.5" r="6.2"/><circle cx="518.5" cy="161.5" r="6.2"/><circle cx="518.5" cy="178.5" r="6.2"/><circle cx="518.5" cy="195.5" r="6.2"/><circle cx="518.5" cy="212.5" r="6.2"/><circle cx="518.5" cy="229.5" r="6.2"/><circle cx="518.5" cy="246.5" r="6.2"/><circle cx="518.5" cy="263.5" r="6.2"/><circle cx="518.5" cy="280.5" r="6.2"/><circle cx="518.5" cy="297.5" r="6.2"/><circle cx="518.5" cy="314.5" r="6.2"/><circle cx="518.5" cy="331.5" r="6.2"/><circle cx="518.5" cy="348.5" r="6.2"/><circle cx="535.5" cy="8.5" r="6.2"/><circle cx="535.5" cy="25.5" r="6.2"/><circle cx="535.5" cy="42.5" r="6.2"/><circle cx="535.5" cy="59.5" r="6.2"/><circle cx="535.5" cy="76.5" r="6.2"/><circle cx="535.5" cy="93.5" r="6.2"/><circle cx="535.5" cy="110.5" r="6.2"/><circle cx="535.5" cy="127.5" r="6.2"/><circle cx="535.5" cy="144.5" r="6.2"/><circle cx="535.5" cy="161.5" r="6.2"/><circle cx="535.5" cy="178.5" r="6.2"/><circle cx="535.5" cy="195.5" r="6.2"/><circle cx="535.5" cy="212.5" r="6.2"/><circle cx="535.5" cy="229.5" r="6.2"/><circle cx="535.5" cy="246.5" r="6.2"/><circle cx="535.5" cy="263.5" r="6.2"/><circle cx="535.5" cy="280.5" r="6.2"/><circle cx="535.5" cy="297.5" r="6.2"/><circle cx="535.5" cy="314.5" r="6.2"/><circle cx="535.5" cy="331.5" r="6.2"/><circle cx="535.5" cy="348.5" r="6.2"/><circle cx="552.5" cy="8.5" r="6.2"/><circle cx="552.5" cy="25.5" r="6.2"/><circle cx="552.5" cy="42.5" r="6.2"/><circle cx="552.5" cy="59.5" r="6.2"/><circle cx="552.5" cy="76.5" r="6.2"/><circle cx="552.5" cy="93.5" r="6.2"/><circle cx="552.5" cy="110.5" r="6.2"/><circle cx="552.5" cy="127.5" r="6.2"/><circle cx="552.5" cy="144.5" r="6.2"/><circle cx="552.5" cy="161.5" r="6.2"/><circle cx="552.5" cy="178.5" r="6.2"/><circle cx="552.5" cy="195.5" r="6.2"/><circle cx="552.5" cy="212.5" r="6.2"/><circle cx="552.5" cy="229.5" r="6.2"/><circle cx="552.5" cy="246.5" r="6.2"/><circle cx="552.5" cy="263.5" r="6.2"/><circle cx="552.5" cy="280.5" r="6.2"/><circle cx="552.5" cy="297.5" r="6.2"/><circle cx="552.5" cy="314.5" r="6.2"/><circle cx="552.5" cy="331.5" r="6.2"/><circle cx="552.5" cy="348.5" r="6.2"/><circle cx="569.5" cy="8.5" r="6.2"/><circle cx="569.5" cy="25.5" r="6.2"/><circle cx="569.5" cy="42.5" r="6.2"/><circle cx="569.5" cy="59.5" r="6.2"/><circle cx="569.5" cy="76.5" r="6.2"/><circle cx="569.5" cy="93.5" r="6.2"/><circle cx="569.5" cy="110.5" r="6.2"/><circle cx="569.5" cy="127.5" r="6.2"/><circle cx="569.5" cy="144.5" r="6.2"/><circle cx="569.5" cy="161.5" r="6.2"/><circle cx="569.5" cy="178.5" r="6.2"/><circle cx="569.5" cy="195.5" r="6.2"/><circle cx="569.5" cy="212.5" r="6.2"/><circle cx="569.5" cy="229.5" r="6.2"/><circle cx="569.5" cy="246.5" r="6.2"/><circle cx="569.5" cy="263.5" r="6.2"/><circle cx="569.5" cy="280.5" r="6.2"/><circle cx="569.5" cy="297.5" r="6.2"/><circle cx="569.5" cy="314.5" r="6.2"/><circle cx="569.5" cy="331.5" r="6.2"/><circle cx="569.5" cy="348.5" r="6.2"/><circle cx="586.5" cy="8.5" r="6.2"/><circle cx="586.5" cy="25.5" r="6.2"/><circle cx="586.5" cy="42.5" r="6.2"/><circle cx="586.5" cy="59.5" r="6.2"/><circle cx="586.5" cy="76.5" r="6.2"/><circle cx="586.5" cy="93.5" r="6.2"/><circle cx="586.5" cy="110.5" r="6.2"/><circle cx="586.5" cy="127.5" r="6.2"/><circle cx="586.5" cy="144.5" r="6.2"/><circle cx="586.5" cy="161.5" r="6.2"/><circle cx="586.5" cy="178.5" r="6.2"/><circle cx="586.5" cy="195.5" r="6.2"/><circle cx="586.5" cy="212.5" r="6.2"/><circle cx="586.5" cy="229.5" r="6.2"/><circle cx="586.5" cy="246.5" r="6.2"/><circle cx="586.5" cy="263.5" r="6.2"/><circle cx="586.5" cy="280.5" r="6.2"/><circle cx="586.5" cy="297.5" r="6.2"/><circle cx="586.5" cy="314.5" r="6.2"/><circle cx="586.5" cy="331.5" r="6.2"/><circle cx="586.5" cy="348.5" r="6.2"/><circle cx="603.5" cy="8.5" r="6.2"/><circle cx="603.5" cy="25.5" r="6.2"/><circle cx="603.5" cy="42.5" r="6.2"/><circle cx="603.5" cy="59.5" r="6.2"/><circle cx="603.5" cy="76.5" r="6.2"/><circle cx="603.5" cy="93.5" r="6.2"/><circle cx="603.5" cy="110.5" r="6.2"/><circle cx="603.5" cy="127.5" r="6.2"/><circle cx="603.5" cy="144.5" r="6.2"/><circle cx="603.5" cy="161.5" r="6.2"/><circle cx="603.5" cy="178.5" r="6.2"/><circle cx="603.5" cy="195.5" r="6.2"/><circle cx="603.5" cy="212.5" r="6.2"/><circle cx="603.5" cy="229.5" r="6.2"/><circle cx="603.5" cy="246.5" r="6.2"/><circle cx="603.5" cy="263.5" r="6.2"/><circle cx="603.5" cy="280.5" r="6.2"/><circle cx="603.5" cy="297.5" r="6.2"/><circle cx="603.5" cy="314.5" r="6.2"/><circle cx="603.5" cy="331.5" r="6.2"/><circle cx="603.5" cy="348.5" r="6.2"/><circle cx="620.5" cy="8.5" r="6.2"/><circle cx="620.5" cy="25.5" r="6.2"/><circle cx="620.5" cy="42.5" r="6.2"/><circle cx="620.5" cy="59.5" r="6.2"/><circle cx="620.5" cy="76.5" r="6.2"/><circle cx="620.5" cy="93.5" r="6.2"/><circle cx="620.5" cy="110.5" r="6.2"/><circle cx="620.5" cy="127.5" r="6.2"/><circle cx="620.5" cy="144.5" r="6.2"/><circle cx="620.5" cy="161.5" r="6.2"/><circle cx="620.5" cy="178.5" r="6.2"/><circle cx="620.5" cy="195.5" r="6.2"/><circle cx="620.5" cy="212.5" r="6.2"/><circle cx="620.5" cy="229.5" r="6.2"/><circle cx="620.5" cy="246.5" r="6.2"/><circle cx="620.5" cy="263.5" r="6.2"/><circle cx="620.5" cy="280.5" r="6.2"/><circle cx="620.5" cy="297.5" r="6.2"/><circle cx="620.5" cy="314.5" r="6.2"/><circle cx="620.5" cy="331.5" r="6.2"/><circle cx="620.5" cy="348.5" r="6.2"/><circle cx="637.5" cy="8.5" r="6.2"/><circle cx="637.5" cy="25.5" r="6.2"/><circle cx="637.5" cy="42.5" r="6.2"/><circle cx="637.5" cy="59.5" r="6.2"/><circle cx="637.5" cy="76.5" r="6.2"/><circle cx="637.5" cy="93.5" r="6.2"/><circle cx="637.5" cy="110.5" r="6.2"/><circle cx="637.5" cy="127.5" r="6.2"/><circle cx="637.5" cy="144.5" r="6.2"/><circle cx="637.5" cy="161.5" r="6.2"/><circle cx="637.5" cy="178.5" r="6.2"/><circle cx="637.5" cy="195.5" r="6.2"/><circle cx="637.5" cy="212.5" r="6.2"/><circle cx="637.5" cy="229.5" r="6.2"/><circle cx="637.5" cy="246.5" r="6.2"/><circle cx="637.5" cy="263.5" r="6.2"/><circle cx="637.5" cy="280.5" r="6.2"/><circle cx="637.5" cy="297.5" r="6.2"/><circle cx="637.5" cy="314.5" r="6.2"/><circle cx="637.5" cy="331.5" r="6.2"/><circle cx="637.5" cy="348.5" r="6.2"/><circle cx="654.5" cy="8.5" r="6.2"/><circle cx="654.5" cy="25.5" r="6.2"/><circle cx="654.5" cy="42.5" r="6.2"/><circle cx="654.5" cy="59.5" r="6.2"/><circle cx="654.5" cy="76.5" r="6.2"/><circle cx="654.5" cy="93.5" r="6.2"/><circle cx="654.5" cy="110.5" r="6.2"/><circle cx="654.5" cy="127.5" r="6.2"/><circle cx="654.5" cy="144.5" r="6.2"/><circle cx="654.5" cy="161.5" r="6.2"/><circle cx="654.5" cy="178.5" r="6.2"/><circle cx="654.5" cy="195.5" r="6.2"/><circle cx="654.5" cy="212.5" r="6.2"/><circle cx="654.5" cy="229.5" r="6.2"/><circle cx="654.5" cy="246.5" r="6.2"/><circle cx="654.5" cy="263.5" r="6.2"/><circle cx="654.5" cy="280.5" r="6.2"/><circle cx="654.5" cy="297.5" r="6.2"/><circle cx="654.5" cy="314.5" r="6.2"/><circle cx="654.5" cy="331.5" r="6.2"/><circle cx="654.5" cy="348.5" r="6.2"/><circle cx="671.5" cy="8.5" r="6.2"/><circle cx="671.5" cy="25.5" r="6.2"/><circle cx="671.5" cy="42.5" r="6.2"/><circle cx="671.5" cy="59.5" r="6.2"/><circle cx="671.5" cy="76.5" r="6.2"/><circle cx="671.5" cy="93.5" r="6.2"/><circle cx="671.5" cy="110.5" r="6.2"/><circle cx="671.5" cy="127.5" r="6.2"/><circle cx="671.5" cy="144.5" r="6.2"/><circle cx="671.5" cy="161.5" r="6.2"/><circle cx="671.5" cy="178.5" r="6.2"/><circle cx="671.5" cy="195.5" r="6.2"/><circle cx="671.5" cy="212.5" r="6.2"/><circle cx="671.5" cy="229.5" r="6.2"/><circle cx="671.5" cy="246.5" r="6.2"/><circle cx="671.5" cy="263.5" r="6.2"/><circle cx="671.5" cy="280.5" r="6.2"/><circle cx="671.5" cy="297.5" r="6.2"/><circle cx="671.5" cy="314.5" r="6.2"/><circle cx="671.5" cy="331.5" r="6.2"/><circle cx="671.5" cy="348.5" r="6.2"/><circle cx="688.5" cy="8.5" r="6.2"/><circle cx="688.5" cy="25.5" r="6.2"/><circle cx="688.5" cy="42.5" r="6.2"/><circle cx="688.5" cy="59.5" r="6.2"/><circle cx="688.5" cy="76.5" r="6.2"/><circle cx="688.5" cy="93.5" r="6.2"/><circle cx="688.5" cy="110.5" r="6.2"/><circle cx="688.5" cy="127.5" r="6.2"/><circle cx="688.5" cy="144.5" r="6.2"/><circle cx="688.5" cy="161.5" r="6.2"/><circle cx="688.5" cy="178.5" r="6.2"/><circle cx="688.5" cy="195.5" r="6.2"/><circle cx="688.5" cy="212.5" r="6.2"/><circle cx="688.5" cy="229.5" r="6.2"/><circle cx="688.5" cy="246.5" r="6.2"/><circle cx="688.5" cy="263.5" r="6.2"/><circle cx="688.5" cy="280.5" r="6.2"/><circle cx="688.5" cy="297.5" r="6.2"/><circle cx="688.5" cy="314.5" r="6.2"/><circle cx="688.5" cy="331.5" r="6.2"/><circle cx="688.5" cy="348.5" r="6.2"/><circle cx="705.5" cy="8.5" r="6.2"/><circle cx="705.5" cy="25.5" r="6.2"/><circle cx="705.5" cy="42.5" r="6.2"/><circle cx="705.5" cy="59.5" r="6.2"/><circle cx="705.5" cy="76.5" r="6.2"/><circle cx="705.5" cy="93.5" r="6.2"/><circle cx="705.5" cy="110.5" r="6.2"/><circle cx="705.5" cy="127.5" r="6.2"/><circle cx="705.5" cy="144.5" r="6.2"/><circle cx="705.5" cy="161.5" r="6.2"/><circle cx="705.5" cy="178.5" r="6.2"/><circle cx="705.5" cy="195.5" r="6.2"/><circle cx="705.5" cy="212.5" r="6.2"/><circle cx="705.5" cy="229.5" r="6.2"/><circle cx="705.5" cy="246.5" r="6.2"/><circle cx="705.5" cy="263.5" r="6.2"/><circle cx="705.5" cy="280.5" r="6.2"/><circle cx="705.5" cy="297.5" r="6.2"/><circle cx="705.5" cy="314.5" r="6.2"/><circle cx="705.5" cy="331.5" r="6.2"/><circle cx="705.5" cy="348.5" r="6.2"/><circle cx="722.5" cy="8.5" r="6.2"/><circle cx="722.5" cy="25.5" r="6.2"/><circle cx="722.5" cy="42.5" r="6.2"/><circle cx="722.5" cy="59.5" r="6.2"/><circle cx="722.5" cy="76.5" r="6.2"/><circle cx="722.5" cy="93.5" r="6.2"/><circle cx="722.5" cy="110.5" r="6.2"/><circle cx="722.5" cy="127.5" r="6.2"/><circle cx="722.5" cy="144.5" r="6.2"/><circle cx="722.5" cy="161.5" r="6.2"/><circle cx="722.5" cy="178.5" r="6.2"/><circle cx="722.5" cy="195.5" r="6.2"/><circle cx="722.5" cy="212.5" r="6.2"/><circle cx="722.5" cy="229.5" r="6.2"/><circle cx="722.5" cy="246.5" r="6.2"/><circle cx="722.5" cy="263.5" r="6.2"/><circle cx="722.5" cy="280.5" r="6.2"/><circle cx="722.5" cy="297.5" r="6.2"/><circle cx="722.5" cy="314.5" r="6.2"/><circle cx="722.5" cy="331.5" r="6.2"/><circle cx="722.5" cy="348.5" r="6.2"/><circle cx="739.5" cy="8.5" r="6.2"/><circle cx="739.5" cy="25.5" r="6.2"/><circle cx="739.5" cy="42.5" r="6.2"/><circle cx="739.5" cy="59.5" r="6.2"/><circle cx="739.5" cy="76.5" r="6.2"/><circle cx="739.5" cy="93.5" r="6.2"/><circle cx="739.5" cy="110.5" r="6.2"/><circle cx="739.5" cy="127.5" r="6.2"/><circle cx="739.5" cy="144.5" r="6.2"/><circle cx="739.5" cy="161.5" r="6.2"/><circle cx="739.5" cy="178.5" r="6.2"/><circle cx="739.5" cy="195.5" r="6.2"/><circle cx="739.5" cy="212.5" r="6.2"/><circle cx="739.5" cy="229.5" r="6.2"/><circle cx="739.5" cy="246.5" r="6.2"/><circle cx="739.5" cy="263.5" r="6.2"/><circle cx="739.5" cy="280.5" r="6.2"/><circle cx="739.5" cy="297.5" r="6.2"/><circle cx="739.5" cy="314.5" r="6.2"/><circle cx="739.5" cy="331.5" r="6.2"/><circle cx="739.5" cy="348.5" r="6.2"/><circle cx="756.5" cy="8.5" r="6.2"/><circle cx="756.5" cy="25.5" r="6.2"/><circle cx="756.5" cy="42.5" r="6.2"/><circle cx="756.5" cy="59.5" r="6.2"/><circle cx="756.5" cy="76.5" r="6.2"/><circle cx="756.5" cy="93.5" r="6.2"/><circle cx="756.5" cy="110.5" r="6.2"/><circle cx="756.5" cy="127.5" r="6.2"/><circle cx="756.5" cy="144.5" r="6.2"/><circle cx="756.5" cy="161.5" r="6.2"/><circle cx="756.5" cy="178.5" r="6.2"/><circle cx="756.5" cy="195.5" r="6.2"/><circle cx="756.5" cy="212.5" r="6.2"/><circle cx="756.5" cy="229.5" r="6.2"/><circle cx="756.5" cy="246.5" r="6.2"/><circle cx="756.5" cy="263.5" r="6.2"/><circle cx="756.5" cy="280.5" r="6.2"/><circle cx="756.5" cy="297.5" r="6.2"/><circle cx="756.5" cy="314.5" r="6.2"/><circle cx="756.5" cy="331.5" r="6.2"/><circle cx="756.5" cy="348.5" r="6.2"/><circle cx="773.5" cy="8.5" r="6.2"/><circle cx="773.5" cy="25.5" r="6.2"/><circle cx="773.5" cy="42.5" r="6.2"/><circle cx="773.5" cy="59.5" r="6.2"/><circle cx="773.5" cy="76.5" r="6.2"/><circle cx="773.5" cy="93.5" r="6.2"/><circle cx="773.5" cy="110.5" r="6.2"/><circle cx="773.5" cy="127.5" r="6.2"/><circle cx="773.5" cy="144.5" r="6.2"/><circle cx="773.5" cy="161.5" r="6.2"/><circle cx="773.5" cy="178.5" r="6.2"/><circle cx="773.5" cy="195.5" r="6.2"/><circle cx="773.5" cy="212.5" r="6.2"/><circle cx="773.5" cy="229.5" r="6.2"/><circle cx="773.5" cy="246.5" r="6.2"/><circle cx="773.5" cy="263.5" r="6.2"/><circle cx="773.5" cy="280.5" r="6.2"/><circle cx="773.5" cy="297.5" r="6.2"/><circle cx="773.5" cy="314.5" r="6.2"/><circle cx="773.5" cy="331.5" r="6.2"/><circle cx="773.5" cy="348.5" r="6.2"/><circle cx="790.5" cy="8.5" r="6.2"/><circle cx="790.5" cy="25.5" r="6.2"/><circle cx="790.5" cy="42.5" r="6.2"/><circle cx="790.5" cy="59.5" r="6.2"/><circle cx="790.5" cy="76.5" r="6.2"/><circle cx="790.5" cy="93.5" r="6.2"/><circle cx="790.5" cy="110.5" r="6.2"/><circle cx="790.5" cy="127.5" r="6.2"/><circle cx="790.5" cy="144.5" r="6.2"/><circle cx="790.5" cy="161.5" r="6.2"/><circle cx="790.5" cy="178.5" r="6.2"/><circle cx="790.5" cy="195.5" r="6.2"/><circle cx="790.5" cy="212.5" r="6.2"/><circle cx="790.5" cy="229.5" r="6.2"/><circle cx="790.5" cy="246.5" r="6.2"/><circle cx="790.5" cy="263.5" r="6.2"/><circle cx="790.5" cy="280.5" r="6.2"/><circle cx="790.5" cy="297.5" r="6.2"/><circle cx="790.5" cy="314.5" r="6.2"/><circle cx="790.5" cy="331.5" r="6.2"/><circle cx="790.5" cy="348.5" r="6.2"/><circle cx="807.5" cy="8.5" r="6.2"/><circle cx="807.5" cy="25.5" r="6.2"/><circle cx="807.5" cy="42.5" r="6.2"/><circle cx="807.5" cy="59.5" r="6.2"/><circle cx="807.5" cy="76.5" r="6.2"/><circle cx="807.5" cy="93.5" r="6.2"/><circle cx="807.5" cy="110.5" r="6.2"/><circle cx="807.5" cy="127.5" r="6.2"/><circle cx="807.5" cy="144.5" r="6.2"/><circle cx="807.5" cy="161.5" r="6.2"/><circle cx="807.5" cy="178.5" r="6.2"/><circle cx="807.5" cy="195.5" r="6.2"/><circle cx="807.5" cy="212.5" r="6.2"/><circle cx="807.5" cy="229.5" r="6.2"/><circle cx="807.5" cy="246.5" r="6.2"/><circle cx="807.5" cy="263.5" r="6.2"/><circle cx="807.5" cy="280.5" r="6.2"/><circle cx="807.5" cy="297.5" r="6.2"/><circle cx="807.5" cy="314.5" r="6.2"/><circle cx="807.5" cy="331.5" r="6.2"/><circle cx="807.5" cy="348.5" r="6.2"/><circle cx="824.5" cy="8.5" r="6.2"/><circle cx="824.5" cy="25.5" r="6.2"/><circle cx="824.5" cy="42.5" r="6.2"/><circle cx="824.5" cy="59.5" r="6.2"/><circle cx="824.5" cy="76.5" r="6.2"/><circle cx="824.5" cy="93.5" r="6.2"/><circle cx="824.5" cy="110.5" r="6.2"/><circle cx="824.5" cy="127.5" r="6.2"/><circle cx="824.5" cy="144.5" r="6.2"/><circle cx="824.5" cy="161.5" r="6.2"/><circle cx="824.5" cy="178.5" r="6.2"/><circle cx="824.5" cy="195.5" r="6.2"/><circle cx="824.5" cy="212.5" r="6.2"/><circle cx="824.5" cy="229.5" r="6.2"/><circle cx="824.5" cy="246.5" r="6.2"/><circle cx="824.5" cy="263.5" r="6.2"/><circle cx="824.5" cy="280.5" r="6.2"/><circle cx="824.5" cy="297.5" r="6.2"/><circle cx="824.5" cy="314.5" r="6.2"/><circle cx="824.5" cy="331.5" r="6.2"/><circle cx="824.5" cy="348.5" r="6.2"/><circle cx="841.5" cy="8.5" r="6.2"/><circle cx="841.5" cy="25.5" r="6.2"/><circle cx="841.5" cy="42.5" r="6.2"/><circle cx="841.5" cy="59.5" r="6.2"/><circle cx="841.5" cy="76.5" r="6.2"/><circle cx="841.5" cy="93.5" r="6.2"/><circle cx="841.5" cy="110.5" r="6.2"/><circle cx="841.5" cy="127.5" r="6.2"/><circle cx="841.5" cy="144.5" r="6.2"/><circle cx="841.5" cy="161.5" r="6.2"/><circle cx="841.5" cy="178.5" r="6.2"/><circle cx="841.5" cy="195.5" r="6.2"/><circle cx="841.5" cy="212.5" r="6.2"/><circle cx="841.5" cy="229.5" r="6.2"/><circle cx="841.5" cy="246.5" r="6.2"/><circle cx="841.5" cy="263.5" r="6.2"/><circle cx="841.5" cy="280.5" r="6.2"/><circle cx="841.5" cy="297.5" r="6.2"/><circle cx="841.5" cy="314.5" r="6.2"/><circle cx="841.5" cy="331.5" r="6.2"/><circle cx="841.5" cy="348.5" r="6.2"/></g><g fill="var(--c4s-ok)" data-tip="136 clean complete recoveries"><circle cx="59.5" cy="229.5" r="6.2"/><circle cx="59.5" cy="246.5" r="6.2"/><circle cx="59.5" cy="263.5" r="6.2"/><circle cx="59.5" cy="280.5" r="6.2"/><circle cx="59.5" cy="297.5" r="6.2"/><circle cx="59.5" cy="314.5" r="6.2"/><circle cx="59.5" cy="331.5" r="6.2"/><circle cx="59.5" cy="348.5" r="6.2"/><circle cx="76.5" cy="8.5" r="6.2"/><circle cx="76.5" cy="25.5" r="6.2"/><circle cx="76.5" cy="42.5" r="6.2"/><circle cx="76.5" cy="59.5" r="6.2"/><circle cx="76.5" cy="76.5" r="6.2"/><circle cx="76.5" cy="93.5" r="6.2"/><circle cx="76.5" cy="110.5" r="6.2"/><circle cx="76.5" cy="127.5" r="6.2"/><circle cx="76.5" cy="144.5" r="6.2"/><circle cx="76.5" cy="161.5" r="6.2"/><circle cx="76.5" cy="178.5" r="6.2"/><circle cx="76.5" cy="195.5" r="6.2"/><circle cx="76.5" cy="212.5" r="6.2"/><circle cx="76.5" cy="229.5" r="6.2"/><circle cx="76.5" cy="246.5" r="6.2"/><circle cx="76.5" cy="263.5" r="6.2"/><circle cx="76.5" cy="280.5" r="6.2"/><circle cx="76.5" cy="297.5" r="6.2"/><circle cx="76.5" cy="314.5" r="6.2"/><circle cx="76.5" cy="331.5" r="6.2"/><circle cx="76.5" cy="348.5" r="6.2"/><circle cx="93.5" cy="8.5" r="6.2"/><circle cx="93.5" cy="25.5" r="6.2"/><circle cx="93.5" cy="42.5" r="6.2"/><circle cx="93.5" cy="59.5" r="6.2"/><circle cx="93.5" cy="76.5" r="6.2"/><circle cx="93.5" cy="93.5" r="6.2"/><circle cx="93.5" cy="110.5" r="6.2"/><circle cx="93.5" cy="127.5" r="6.2"/><circle cx="93.5" cy="144.5" r="6.2"/><circle cx="93.5" cy="161.5" r="6.2"/><circle cx="93.5" cy="178.5" r="6.2"/><circle cx="93.5" cy="195.5" r="6.2"/><circle cx="93.5" cy="212.5" r="6.2"/><circle cx="93.5" cy="229.5" r="6.2"/><circle cx="93.5" cy="246.5" r="6.2"/><circle cx="93.5" cy="263.5" r="6.2"/><circle cx="93.5" cy="280.5" r="6.2"/><circle cx="93.5" cy="297.5" r="6.2"/><circle cx="93.5" cy="314.5" r="6.2"/><circle cx="93.5" cy="331.5" r="6.2"/><circle cx="93.5" cy="348.5" r="6.2"/><circle cx="110.5" cy="8.5" r="6.2"/><circle cx="110.5" cy="25.5" r="6.2"/><circle cx="110.5" cy="42.5" r="6.2"/><circle cx="110.5" cy="59.5" r="6.2"/><circle cx="110.5" cy="76.5" r="6.2"/><circle cx="110.5" cy="93.5" r="6.2"/><circle cx="110.5" cy="110.5" r="6.2"/><circle cx="110.5" cy="127.5" r="6.2"/><circle cx="110.5" cy="144.5" r="6.2"/><circle cx="110.5" cy="161.5" r="6.2"/><circle cx="110.5" cy="178.5" r="6.2"/><circle cx="110.5" cy="195.5" r="6.2"/><circle cx="110.5" cy="212.5" r="6.2"/><circle cx="110.5" cy="229.5" r="6.2"/><circle cx="110.5" cy="246.5" r="6.2"/><circle cx="110.5" cy="263.5" r="6.2"/><circle cx="110.5" cy="280.5" r="6.2"/><circle cx="110.5" cy="297.5" r="6.2"/><circle cx="110.5" cy="314.5" r="6.2"/><circle cx="110.5" cy="331.5" r="6.2"/><circle cx="110.5" cy="348.5" r="6.2"/><circle cx="127.5" cy="8.5" r="6.2"/><circle cx="127.5" cy="25.5" r="6.2"/><circle cx="127.5" cy="42.5" r="6.2"/><circle cx="127.5" cy="59.5" r="6.2"/><circle cx="127.5" cy="76.5" r="6.2"/><circle cx="127.5" cy="93.5" r="6.2"/><circle cx="127.5" cy="110.5" r="6.2"/><circle cx="127.5" cy="127.5" r="6.2"/><circle cx="127.5" cy="144.5" r="6.2"/><circle cx="127.5" cy="161.5" r="6.2"/><circle cx="127.5" cy="178.5" r="6.2"/><circle cx="127.5" cy="195.5" r="6.2"/><circle cx="127.5" cy="212.5" r="6.2"/><circle cx="127.5" cy="229.5" r="6.2"/><circle cx="127.5" cy="246.5" r="6.2"/><circle cx="127.5" cy="263.5" r="6.2"/><circle cx="127.5" cy="280.5" r="6.2"/><circle cx="127.5" cy="297.5" r="6.2"/><circle cx="127.5" cy="314.5" r="6.2"/><circle cx="127.5" cy="331.5" r="6.2"/><circle cx="127.5" cy="348.5" r="6.2"/><circle cx="144.5" cy="8.5" r="6.2"/><circle cx="144.5" cy="25.5" r="6.2"/><circle cx="144.5" cy="42.5" r="6.2"/><circle cx="144.5" cy="59.5" r="6.2"/><circle cx="144.5" cy="76.5" r="6.2"/><circle cx="144.5" cy="93.5" r="6.2"/><circle cx="144.5" cy="110.5" r="6.2"/><circle cx="144.5" cy="127.5" r="6.2"/><circle cx="144.5" cy="144.5" r="6.2"/><circle cx="144.5" cy="161.5" r="6.2"/><circle cx="144.5" cy="178.5" r="6.2"/><circle cx="144.5" cy="195.5" r="6.2"/><circle cx="144.5" cy="212.5" r="6.2"/><circle cx="144.5" cy="229.5" r="6.2"/><circle cx="144.5" cy="246.5" r="6.2"/><circle cx="144.5" cy="263.5" r="6.2"/><circle cx="144.5" cy="280.5" r="6.2"/><circle cx="144.5" cy="297.5" r="6.2"/><circle cx="144.5" cy="314.5" r="6.2"/><circle cx="144.5" cy="331.5" r="6.2"/><circle cx="144.5" cy="348.5" r="6.2"/><circle cx="161.5" cy="8.5" r="6.2"/><circle cx="161.5" cy="25.5" r="6.2"/><circle cx="161.5" cy="42.5" r="6.2"/><circle cx="161.5" cy="59.5" r="6.2"/><circle cx="161.5" cy="76.5" r="6.2"/><circle cx="161.5" cy="93.5" r="6.2"/><circle cx="161.5" cy="110.5" r="6.2"/><circle cx="161.5" cy="127.5" r="6.2"/><circle cx="161.5" cy="144.5" r="6.2"/><circle cx="161.5" cy="161.5" r="6.2"/><circle cx="161.5" cy="178.5" r="6.2"/><circle cx="161.5" cy="195.5" r="6.2"/><circle cx="161.5" cy="212.5" r="6.2"/><circle cx="161.5" cy="229.5" r="6.2"/><circle cx="161.5" cy="246.5" r="6.2"/><circle cx="161.5" cy="263.5" r="6.2"/><circle cx="161.5" cy="280.5" r="6.2"/><circle cx="161.5" cy="297.5" r="6.2"/><circle cx="161.5" cy="314.5" r="6.2"/><circle cx="161.5" cy="331.5" r="6.2"/><circle cx="161.5" cy="348.5" r="6.2"/><circle cx="178.5" cy="8.5" r="6.2"/><circle cx="178.5" cy="25.5" r="6.2"/></g><g fill="var(--c4s-hot)" data-tip="76 complete recoveries that also changed something else"><circle cx="8.5" cy="8.5" r="6.2"/><circle cx="8.5" cy="25.5" r="6.2"/><circle cx="8.5" cy="42.5" r="6.2"/><circle cx="8.5" cy="59.5" r="6.2"/><circle cx="8.5" cy="76.5" r="6.2"/><circle cx="8.5" cy="93.5" r="6.2"/><circle cx="8.5" cy="110.5" r="6.2"/><circle cx="8.5" cy="127.5" r="6.2"/><circle cx="8.5" cy="144.5" r="6.2"/><circle cx="8.5" cy="161.5" r="6.2"/><circle cx="8.5" cy="178.5" r="6.2"/><circle cx="8.5" cy="195.5" r="6.2"/><circle cx="8.5" cy="212.5" r="6.2"/><circle cx="8.5" cy="229.5" r="6.2"/><circle cx="8.5" cy="246.5" r="6.2"/><circle cx="8.5" cy="263.5" r="6.2"/><circle cx="8.5" cy="280.5" r="6.2"/><circle cx="8.5" cy="297.5" r="6.2"/><circle cx="8.5" cy="314.5" r="6.2"/><circle cx="8.5" cy="331.5" r="6.2"/><circle cx="8.5" cy="348.5" r="6.2"/><circle cx="25.5" cy="8.5" r="6.2"/><circle cx="25.5" cy="25.5" r="6.2"/><circle cx="25.5" cy="42.5" r="6.2"/><circle cx="25.5" cy="59.5" r="6.2"/><circle cx="25.5" cy="76.5" r="6.2"/><circle cx="25.5" cy="93.5" r="6.2"/><circle cx="25.5" cy="110.5" r="6.2"/><circle cx="25.5" cy="127.5" r="6.2"/><circle cx="25.5" cy="144.5" r="6.2"/><circle cx="25.5" cy="161.5" r="6.2"/><circle cx="25.5" cy="178.5" r="6.2"/><circle cx="25.5" cy="195.5" r="6.2"/><circle cx="25.5" cy="212.5" r="6.2"/><circle cx="25.5" cy="229.5" r="6.2"/><circle cx="25.5" cy="246.5" r="6.2"/><circle cx="25.5" cy="263.5" r="6.2"/><circle cx="25.5" cy="280.5" r="6.2"/><circle cx="25.5" cy="297.5" r="6.2"/><circle cx="25.5" cy="314.5" r="6.2"/><circle cx="25.5" cy="331.5" r="6.2"/><circle cx="25.5" cy="348.5" r="6.2"/><circle cx="42.5" cy="8.5" r="6.2"/><circle cx="42.5" cy="25.5" r="6.2"/><circle cx="42.5" cy="42.5" r="6.2"/><circle cx="42.5" cy="59.5" r="6.2"/><circle cx="42.5" cy="76.5" r="6.2"/><circle cx="42.5" cy="93.5" r="6.2"/><circle cx="42.5" cy="110.5" r="6.2"/><circle cx="42.5" cy="127.5" r="6.2"/><circle cx="42.5" cy="144.5" r="6.2"/><circle cx="42.5" cy="161.5" r="6.2"/><circle cx="42.5" cy="178.5" r="6.2"/><circle cx="42.5" cy="195.5" r="6.2"/><circle cx="42.5" cy="212.5" r="6.2"/><circle cx="42.5" cy="229.5" r="6.2"/><circle cx="42.5" cy="246.5" r="6.2"/><circle cx="42.5" cy="263.5" r="6.2"/><circle cx="42.5" cy="280.5" r="6.2"/><circle cx="42.5" cy="297.5" r="6.2"/><circle cx="42.5" cy="314.5" r="6.2"/><circle cx="42.5" cy="331.5" r="6.2"/><circle cx="42.5" cy="348.5" r="6.2"/><circle cx="59.5" cy="8.5" r="6.2"/><circle cx="59.5" cy="25.5" r="6.2"/><circle cx="59.5" cy="42.5" r="6.2"/><circle cx="59.5" cy="59.5" r="6.2"/><circle cx="59.5" cy="76.5" r="6.2"/><circle cx="59.5" cy="93.5" r="6.2"/><circle cx="59.5" cy="110.5" r="6.2"/><circle cx="59.5" cy="127.5" r="6.2"/><circle cx="59.5" cy="144.5" r="6.2"/><circle cx="59.5" cy="161.5" r="6.2"/><circle cx="59.5" cy="178.5" r="6.2"/><circle cx="59.5" cy="195.5" r="6.2"/><circle cx="59.5" cy="212.5" r="6.2"/></g></svg><figcaption>One dot per Image-to-Scene evaluation (paper Figure 6c).</figcaption></figure></div></div></div></section><section id="cases"><div class="container">
<div class="section-header centered"><span class="section-label">Cases</span><h2 class="section-title">Turn the scenes yourself</h2>
<p class="section-desc">For each selected case, every agent's saved scene is exported from Unreal Engine and opens in the browser in 3D, beside the evaluator's scores for it.</p></div>
<div class="case-grid"><a class="case-card" href="cases.html#nordic-harbour"><div class="th" style="background-image:url('media/t2s/nordic-harbour/astra.jpg?v=1790542380')"><i>Text-to-Scene</i></div><div class="meta"><h4>Nordic Harbour</h4><p>14 agents scored · 11 scenes in 3D · best 0.877 (Astra)</p></div></a><a class="case-card" href="cases.html#medieval-big-farm-town"><div class="th" style="background-image:url('media/t2s/medieval-big-farm-town/fable.jpg?v=1790542357')"><i>Text-to-Scene</i></div><div class="meta"><h4>Medieval Big Farm Town</h4><p>14 agents scored · 6 scenes in 3D · best 0.830 (Fable)</p></div></a><a class="case-card" href="cases.html#egyptian-temple"><div class="th" style="background-image:url('media/t2s/egyptian-temple/opus.jpg?v=1790542327')"><i>Text-to-Scene</i></div><div class="meta"><h4>Egyptian Temple</h4><p>14 agents scored · 6 scenes in 3D · best 0.777 (Opus)</p></div></a><a class="case-card" href="cases.html#bazaar"><div class="th" style="background-image:url('media/t2s/bazaar/fable.jpg?v=1790542281')"><i>Text-to-Scene</i></div><div class="meta"><h4>Bazaar</h4><p>14 agents scored · 6 scenes in 3D · best 0.930 (Fable)</p></div></a><a class="case-card" href="cases.html#comp-31-old-industrial-pallet-bay-repair-v2"><div class="th" style="background-image:url('media/i2s/comp-31-old-industrial-pallet-bay-repair-v2/astra.jpg?v=1790731230')"><i>Image-to-Scene</i></div><div class="meta"><h4>Old Industrial Pallet Bay</h4><p>14 agents scored · 6 scenes in 3D · best 1.000 (Astra)</p></div></a><a class="case-card" href="cases.html#comp-61-new-york-mailbox-pair-repair-v2"><div class="th" style="background-image:url('media/i2s/comp-61-new-york-mailbox-pair-repair-v2/deepseek.jpg?v=1790550039')"><i>Image-to-Scene</i></div><div class="meta"><h4>New York Mailbox Pair</h4><p>14 agents scored · 6 scenes in 3D · best 1.000 (DeepSeek)</p></div></a></div>
<div style="text-align:center;margin-top:2rem"><a class="btn btn-primary" href="cases.html"><svg viewBox="0 0 16 16" fill="none" stroke="currentColor" stroke-width="1.5" aria-hidden="true"><path d="M8 1.5l5.5 3v7L8 14.5l-5.5-3v-7z"/><path d="M2.5 4.5L8 7.5l5.5-3M8 7.5v7"/></svg> Open the case explorer</a></div>
</div></section><section class="dark" id="citation"><div class="container">
<div class="section-header centered"><span class="section-label">Citation</span><h2 class="section-title">Cite This Work</h2></div>
<div class="cite-box"><button class="cite-copy-btn" id="copy-btn">Copy</button><pre id="bibtex-text">@article{code4scene2026,
title = {Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes},
author = {Ye, Xiaokang and Mantri, Siddhant Hitesh and Chen, Zimeng and Zhang, Edward and Zheng, Zhaoxu and Li, Yuanheng and Chen, Yizhao and Huang, Tianyang and Qin, Lianhui},
year = {2026}
}</pre></div>
<div style="display:flex;flex-wrap:wrap;gap:1rem;justify-content:center;margin-top:2rem">
<a class="btn btn-outline" href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> GitHub Repository</a>
<a class="btn btn-outline" href="https://simworld.org/" target="_blank" rel="noopener">SimWorld Main Site</a></div>
</div></section>
<footer><p>Code4Scene · UC San Diego & UC Berkeley · <a href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener">GitHub</a> ·
<a href="https://simworld.org/" target="_blank" rel="noopener">SimWorld Home</a></p>
<p style="margin-top:.5rem;font-size:.75rem;color:rgba(255,255,255,.25)">Part of the SimWorld project.</p></footer>
<script src="assets/paper.js?v=5427505a"></script>
</body></html> |