Spaces:
Running
Running
| <html lang="en"><head> | |
| <meta charset="utf-8"><meta name="viewport" content="width=device-width,initial-scale=1"> | |
| <title>Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes</title><meta name="description" content="A benchmark of 190 Unreal Engine cases that scores the engine-native scenes coding agents build and edit."> | |
| <link rel="icon" href="data:image/svg+xml,<svg viewBox='0 0 32 32' aria-hidden='true'><defs><linearGradient id='gi' x1='0' y1='0' x2='1' y2='1'><stop offset='0' stop-color='%2392400e'/><stop offset='1' stop-color='%23d97706'/></linearGradient></defs><rect x='1' y='1' width='30' height='30' rx='8' fill='url(%23gi)'/><path d='M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z' fill='none' stroke='%23fff' stroke-width='2' stroke-linejoin='round'/><path d='M7 11.5 16 16.5 25 11.5M16 16.5v9' fill='none' stroke='%23fff' stroke-width='2' stroke-linejoin='round'/></svg>"> | |
| <link rel="preconnect" href="https://fonts.googleapis.com"><link rel="preconnect" href="https://fonts.gstatic.com" crossorigin> | |
| <link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=Inter:wght@300;400;500;600;700;800;900&family=DM+Sans:wght@400;500&family=JetBrains+Mono:wght@400;500&display=swap"> | |
| <link rel="stylesheet" href="assets/paper.css?v=5427505a"> | |
| <style> | |
| :root{--c4s-a:#5a67d8;--c4s-b:#d97706;--c4s-hot:#dc4a2d;--c4s-ok:#0f9f6e;--c4s-g1:#8b93a7;--c4s-g2:#aab1c2;--c4s-g3:#cdd2de;--c4s-seq:#5a67d8;--c4s-unit:#e3e7f0} | |
| svg.ch{width:100%;height:auto;display:block;font-family:Inter,system-ui,sans-serif;overflow:visible} | |
| svg.ch text{fill:var(--text-secondary);font-size:13px}svg.ch .b{fill:var(--text-primary);font-weight:700}svg.ch .m{fill:var(--text-muted);font-size:12px} | |
| svg.ch .num{font-variant-numeric:tabular-nums}svg.ch .grid{stroke:var(--line-soft);stroke-width:1}svg.ch .axis{stroke:var(--line-strong);stroke-width:1} | |
| svg.ch .dim{opacity:.42}svg.ch g.row:hover{opacity:1}svg.ch .hot{fill:var(--c4s-hot);font-weight:700} | |
| .ch-legend{display:flex;flex-wrap:wrap;gap:6px 18px;margin:0 0 10px;font-size:13px;color:var(--text-secondary)} | |
| .ch-legend span{display:inline-flex;align-items:center;gap:7px}.ch-legend i{width:12px;height:12px;border-radius:3px;display:inline-block} | |
| .ev{position:relative;border-radius:var(--radius-sm);overflow:hidden;border:1px solid var(--line-soft)}.ev img{display:block;width:100%} | |
| .ev svg{position:absolute;inset:0;width:100%;height:100%} | |
| .chips{display:flex;flex-wrap:wrap;gap:8px;margin-top:10px}.chip{font-size:13px;font-weight:600;padding:4px 10px;border-radius:999px;border:1px solid var(--line)} | |
| .chip.ok{color:var(--c4s-ok);border-color:currentColor}.chip.no{color:var(--c4s-hot);border-color:currentColor}.chip small{font-weight:500;color:var(--text-muted);margin-left:4px} | |
| .bigstats{display:flex;flex-wrap:wrap;gap:12px 34px;margin:0 0 12px}.bigstats b{display:block;font-size:30px;letter-spacing:-.02em;font-variant-numeric:tabular-nums} | |
| .bigstats span{font-size:13px;color:var(--text-secondary)} | |
| </style></head><body> | |
| <nav class="navbar"><a class="navbar-brand" href="index.html"><svg viewBox="0 0 32 32" aria-hidden="true"><defs><linearGradient id="gi" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#92400e"/><stop offset="1" stop-color="#d97706"/></linearGradient></defs><rect x="1" y="1" width="30" height="30" rx="8" fill="url(#gi)"/><path d="M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/><path d="M7 11.5 16 16.5 25 11.5M16 16.5v9" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/></svg>Code4Scene</a><ul class="navbar-links"><li class=""><a href="index.html#leaderboard" class=on>Leaderboard</a></li><li class="hide-sm"><a href="index.html#takeaways">Takeaways</a></li><li class=""><a href="cases.html">Cases in 3D</a></li><li class="hide-sm"><a href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> Code</a></li><li><a class="btn-nav-primary" href="https://simworld.org/" target="_blank" rel="noopener"><img src="img/simworld-logo.png" alt="">SimWorld Home</a></li></ul></nav> | |
| <section class="hero" id="hero"><div class="hero-inner"> | |
| <h1 class="hero-title"><svg viewBox="0 0 32 32" aria-hidden="true"><defs><linearGradient id="gi" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#92400e"/><stop offset="1" stop-color="#d97706"/></linearGradient></defs><rect x="1" y="1" width="30" height="30" rx="8" fill="url(#gi)"/><path d="M16 6.5 25 11.5v9L16 25.5 7 20.5v-9z" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/><path d="M7 11.5 16 16.5 25 11.5M16 16.5v9" fill="none" stroke="#fff" stroke-width="2" stroke-linejoin="round"/></svg><span class="highlight">Code4Scene</span>:<br>Benchmarking Coding Agents for<br>Constructing and Editing 3D Scenes</h1> | |
| <p class="hero-subtitle">190 Unreal Engine cases built from human-assembled scenes. Coding agents write and run code that builds a scene from text, or | |
| repairs one from reference images, and Code4Scene scores the engine-native scene they save, not their code or a rendered view.</p> | |
| <p class="hero-authors"><span class="author">Xiaokang Ye</span><sup>1,*</sup>, <span class="author">Siddhant Hitesh Mantri</span><sup>1,*</sup>, | |
| <span class="author">Zimeng Chen</span><sup>1,*</sup>, <span class="author">Edward Zhang</span><sup>1</sup>, <span class="author">Zhaoxu Zheng</span><sup>1</sup>,<br> | |
| <span class="author">Yuanheng Li</span><sup>2</sup>, <span class="author">Yizhao Chen</span><sup>1</sup>, <span class="author">Tianyang Huang</span><sup>1</sup>, | |
| <span class="author">Lianhui Qin</span><sup>1,†</sup></p> | |
| <p class="hero-affiliations"><sup>1</sup>University of California San Diego <sup>2</sup>University of California, Berkeley | |
| <sup>*</sup>Equal contribution <sup>†</sup>Corresponding author</p> | |
| <div class="hero-buttons"><span class="btn btn-primary off" title="Coming soon"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M4 0h5.5L14 4.5V14a2 2 0 01-2 2H4a2 2 0 01-2-2V2a2 2 0 012-2zm5 1.5V5h3.5L9 1.5zM5 8h6v1H5zm0 2.5h6v1H5z"/></svg> Paper (soon)</span> | |
| <a class="btn btn-outline" href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> Code & Data</a> | |
| <a class="btn btn-dark" href="#teaser"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0a8 8 0 110 16A8 8 0 018 0zM6.5 4.8v6.4L11.3 8z"/></svg> Watch the teaser</a><a class="btn btn-dark" href="cases.html"><svg viewBox="0 0 16 16" fill="none" stroke="currentColor" stroke-width="1.5" aria-hidden="true"><path d="M8 1.5l5.5 3v7L8 14.5l-5.5-3v-7z"/><path d="M2.5 4.5L8 7.5l5.5-3M8 7.5v7"/></svg> Cases in 3D</a></div> | |
| <div class="hero-stats"> | |
| <div class="hero-stat"><div class="stat-num"><span>190</span></div><div class="stat-label">Unreal Engine cases</div><div class="stat-note">95 public, scored here</div></div> | |
| <div class="hero-stat"><div class="stat-num"><span>14</span></div><div class="stat-label">coding-agent configurations</div><div class="stat-note">frontier and open weights</div></div> | |
| <div class="hero-stat"><div class="stat-num"><span>0.619</span></div><div class="stat-label">best overall score</div><div class="stat-note">Astra and Gemini, tied</div></div> | |
| <div class="hero-stat"><div class="stat-num"><span>35.8%</span></div><div class="stat-label">of complete repairs</div><div class="stat-note">still change the rest of the scene</div></div> | |
| </div></div></section><section class="dark" id="teaser"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Teaser</span><h2 class="section-title">How Code4Scene scores a scene</h2> | |
| <p class="section-desc">The leaderboard, one scene through the evaluator, two scenes compared, and what the benchmark finds, in 90 seconds.</p></div> | |
| <div class="teaser-frame"><video controls playsinline preload="metadata" poster="media/teaser-poster.jpg"><source src="media/teaser.mp4" type="video/mp4"></video></div> | |
| </div></section><section class="alt" id="overview"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Overview</span><h2 class="section-title">Score the scene, not the code or a render</h2></div> | |
| <div class="card abstract-card"><p>Coding agents can now operate 3D engines: they write and run code, inspect the result and revise the scene. Code4Scene is a | |
| benchmark of 190 Unreal Engine cases built from human-assembled scenes that evaluates them on two complementary settings under a shared execution | |
| interface. <b>Construction</b> starts from an empty level and an open-ended text specification. <b>Editing</b> gives the agent a corrupted copy of a | |
| scene and reference images of the original, and asks it to restore the intended state while leaving everything else untouched.</p> | |
| <p>Rather than scoring code or rendered views, Code4Scene evaluates the engine-native scene the agent saved, on task fulfilment, artifact integrity | |
| and static physical validity, and compares edits against withheld ground truth. Across 14 agent configurations, construction and editing rank the | |
| agents differently, spatial relations remain the weakest requirement family, and a third of complete repairs still change the surrounding scene.</p></div> | |
| <div class="flow"><div class="step"><span class="n">1 · Input</span><b>Prompt or reference</b><span>An open-ended scene description, or a corrupted scene with reference images of the original.</span></div><div class="step"><span class="n">2 · Agent</span><b>Coding agent</b><span>A frontier or open-weight model in its own CLI harness, with the Unreal Engine editor as a tool.</span></div><div class="step"><span class="n">3 · Code</span><b>Code in the engine</b><span>It writes and runs Python against the editor: spawns, moves and edits actors, inspects, revises.</span></div><div class="step"><span class="n">4 · Scene</span><b>Engine-native scene</b><span>The saved level (.umap): every actor, transform and material, as the engine holds it.</span></div><div class="step eval"><span class="n">5 · Evaluator</span><b>Scored in the engine</b><span>Requirements located and judged, overview views judged, physics measured, edits diffed against the withheld ground truth.</span></div></div> | |
| <div class="grid2" style="margin-top:2rem"> | |
| <div class="card setting-card"><span class="kicker">Setting 1 · construction</span><h3>Text-to-Scene</h3> | |
| <p>From an empty level and the content pack's asset catalog, the agent builds the scene a prompt describes. Many realizations are valid, so the | |
| evaluator judges requirements rather than matching a reference. 20 public cases.</p> | |
| <div class="formula">case score = 0.2 × Detailed Alignment + 0.6 × Overview Alignment + 0.2 × Physical Safety</div></div> | |
| <div class="card setting-card"><span class="kicker">Setting 2 · editing</span><h3>Image-to-Scene</h3> | |
| <p>The agent gets a corrupted copy of a human-assembled scene and reference views of the original. It must restore every target actor (within | |
| 5 cm, 5° and 5%) and change nothing else. 75 public cases: 25 indoor, 50 outdoor.</p> | |
| <div class="formula">case score = 0.8 × Repair F1 + 0.2 × Physical Safety</div></div></div> | |
| </div></section><section id="leaderboard"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Leaderboard</span><h2 class="section-title">14 coding agents on the public set</h2> | |
| <p class="section-desc">Scores are from the paper's Table 2. Pick a setting; the chart and the table follow.</p></div> | |
| <div id="lbwrap"><div class="lb-tabs"><div class="seg seg-lg" data-for="lbwrap"><button data-view="overall" class=on>Overall</button><button data-view="t2s">Text-to-Scene</button><button data-view="i2s">Image-to-Scene</button></div></div> | |
| <div class="card chart-card"><div class="sub-title">Score against cost</div> | |
| <div class="sub-desc">Each agent's score against what one case cost it. The line is the frontier: no agent left of it scores higher. Hover a point for its numbers.</div> | |
| <div class="ch-legend"><span><i style="background:#0f9f6e;border-radius:50%"></i>OpenAI</span><span><i style="background:#3b82f6;border-radius:50%"></i>Google</span><span><i style="background:#c2410c;border-radius:50%"></i>Anthropic</span><span><i style="background:#8b5cf6;border-radius:50%"></i>Meta</span><span><i style="background:#475569;border-radius:50%"></i>Z.ai</span><span><i style="background:#f59e0b;border-radius:50%"></i>Alibaba</span><span><i style="background:#e11d48;border-radius:50%"></i>xAI</span><span><i style="background:#a16207;border-radius:50%"></i>Thinking Machines</span><span><i style="background:#06b6d4;border-radius:50%"></i>DeepSeek</span><span><i style="background:#fff;border:2px solid var(--text-h);border-radius:50%;box-sizing:border-box"></i>on the frontier</span></div><svg class="ch pareto" viewBox="0 0 900 400" role="img" aria-label="Score against estimated cost per case"><g data-view="overall"><line class="grid" x1="52" x2="880" y1="323.1" y2="323.1"/><text x="44" y="327.1" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="261.3" y2="261.3"/><text x="44" y="265.3" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="199.5" y2="199.5"/><text x="44" y="203.5" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="137.6" y2="137.6"/><text x="44" y="141.6" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="75.8" y2="75.8"/><text x="44" y="79.8" text-anchor="end" class="m num">0.60</text><line class="grid" x1="52" x2="880" y1="14.0" y2="14.0"/><text x="44" y="18.0" text-anchor="end" class="m num">0.70</text><text x="158.9" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="158.9" x2="158.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="283.9" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="283.9" x2="283.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="397.9" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="397.9" x2="397.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="522.9" y="372" text-anchor="middle" class="m num">$1</text><line x1="522.9" x2="522.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="637.0" y="372" text-anchor="middle" class="m num">$3</text><line x1="637.0" x2="637.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="762.0" y="372" text-anchor="middle" class="m num">$10</text><line x1="762.0" x2="762.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="876.0" y="372" text-anchor="middle" class="m num">$30</text><line x1="876.0" x2="876.0" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M100.8,270.5 L147.4,270.5 L147.4,262.5 L268.3,262.5 L268.3,136.4 L590.8,136.4 L590.8,64.1 L880.0,64.1 L880,354 L100.8,354 Z"/><path class="frontier" d="M100.8,270.5 L147.4,270.5 L147.4,262.5 L268.3,262.5 L268.3,136.4 L590.8,136.4 L590.8,64.1 L880.0,64.1"/><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Overall", "0.619"], ["cost per case", "$1.92"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="590.8" cy="64.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Overall", "0.502"], ["cost per case", "$0.09"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="268.3" cy="136.4" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Overall", "0.298"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="147.4" cy="262.5" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Overall", "0.285"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="100.8" cy="270.5" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Overall", "0.619"], ["cost per case", "$12.90"], ["provider", "OpenAI"]]}'><circle cx="788.4" cy="64.1" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Overall", "0.606"], ["cost per case", "$10.62"], ["provider", "Anthropic"]]}'><circle cx="768.3" cy="72.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Overall", "0.593"], ["cost per case", "$19.48"], ["provider", "Anthropic"]]}'><circle cx="831.2" cy="80.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Overall", "0.550"], ["cost per case", "$2.97"], ["provider", "OpenAI"]]}'><circle cx="636.1" cy="106.7" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Overall", "0.415"], ["cost per case", "$0.40"], ["provider", "Z.ai"]]}'><circle cx="428.1" cy="190.2" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Overall", "0.378"], ["cost per case", "$0.38"], ["provider", "Alibaba"]]}'><circle cx="423.6" cy="213.1" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Overall", "0.376"], ["cost per case", "$2.29"], ["provider", "xAI"]]}'><circle cx="609.2" cy="214.3" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Overall", "0.371"], ["cost per case", "$0.30"], ["provider", "Alibaba"]]}'><circle cx="397.1" cy="217.4" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Overall", "0.312"], ["cost per case", "$0.48"], ["provider", "Thinking Machines"]]}'><circle cx="446.4" cy="253.9" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Overall", "0.227"], ["cost per case", "$0.12"], ["provider", "DeepSeek"]]}'><circle cx="306.2" cy="306.4" r="5.5" fill="#06b6d4" stroke="#fff" stroke-width="1.5"/></g><text x="580.8" y="68.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="258.3" y="140.4" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="147.4" y="250.5" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="100.8" y="290.5" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="788.4" y="52.1" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="768.3" y="92.1" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="841.2" y="84.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="646.1" y="110.7" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="438.1" y="194.2" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="433.6" y="217.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="619.2" y="218.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text><text x="387.1" y="221.4" text-anchor="end" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="456.4" y="257.9" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="316.2" y="310.4" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text></g><g data-view="t2s" style="display:none"><line class="grid" x1="52" x2="880" y1="329.7" y2="329.7"/><text x="44" y="333.7" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="281.1" y2="281.1"/><text x="44" y="285.1" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="232.6" y2="232.6"/><text x="44" y="236.6" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="184.0" y2="184.0"/><text x="44" y="188.0" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="135.4" y2="135.4"/><text x="44" y="139.4" text-anchor="end" class="m num">0.60</text><line class="grid" x1="52" x2="880" y1="86.9" y2="86.9"/><text x="44" y="90.9" text-anchor="end" class="m num">0.70</text><line class="grid" x1="52" x2="880" y1="38.3" y2="38.3"/><text x="44" y="42.3" text-anchor="end" class="m num">0.80</text><text x="57.1" y="372" text-anchor="middle" class="m num">$0.01</text><line x1="57.1" x2="57.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="162.1" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="162.1" x2="162.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="277.0" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="277.0" x2="277.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="382.0" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="382.0" x2="382.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="497.0" y="372" text-anchor="middle" class="m num">$1</text><line x1="497.0" x2="497.0" y1="354" y2="358" stroke="var(--line-strong)"/><text x="601.9" y="372" text-anchor="middle" class="m num">$3</text><line x1="601.9" x2="601.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="716.9" y="372" text-anchor="middle" class="m num">$10</text><line x1="716.9" x2="716.9" y1="354" y2="358" stroke="var(--line-strong)"/><text x="821.8" y="372" text-anchor="middle" class="m num">$30</text><line x1="821.8" x2="821.8" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M96.9,205.9 L145.8,205.9 L145.8,198.1 L277.5,198.1 L277.5,113.1 L584.3,113.1 L584.3,107.7 L631.1,107.7 L631.1,83.5 L773.8,83.5 L773.8,44.1 L880.0,44.1 L880,354 L96.9,354 Z"/><path class="frontier" d="M96.9,205.9 L145.8,205.9 L145.8,198.1 L277.5,198.1 L277.5,113.1 L584.3,113.1 L584.3,107.7 L631.1,107.7 L631.1,83.5 L773.8,83.5 L773.8,44.1 L880.0,44.1"/><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Text-to-Scene", "0.788"], ["cost per case", "$18.16"], ["provider", "Anthropic"], ["", "on the frontier"]]}'><circle cx="773.8" cy="44.1" r="7" fill="#c2410c" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Text-to-Scene", "0.707"], ["cost per case", "$4.07"], ["provider", "OpenAI"], ["", "on the frontier"]]}'><circle cx="631.1" cy="83.5" r="7" fill="#0f9f6e" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Text-to-Scene", "0.657"], ["cost per case", "$2.49"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="584.3" cy="107.7" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Text-to-Scene", "0.646"], ["cost per case", "$0.10"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="277.5" cy="113.1" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Text-to-Scene", "0.471"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="145.8" cy="198.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Text-to-Scene", "0.455"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="96.9" cy="205.9" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Text-to-Scene", "0.724"], ["cost per case", "$22.47"], ["provider", "OpenAI"]]}'><circle cx="794.2" cy="75.2" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Text-to-Scene", "0.718"], ["cost per case", "$34.50"], ["provider", "Anthropic"]]}'><circle cx="835.1" cy="78.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Text-to-Scene", "0.567"], ["cost per case", "$4.33"], ["provider", "xAI"]]}'><circle cx="636.8" cy="151.5" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Text-to-Scene", "0.557"], ["cost per case", "$0.49"], ["provider", "Alibaba"]]}'><circle cx="429.1" cy="156.3" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Text-to-Scene", "0.516"], ["cost per case", "$0.33"], ["provider", "Alibaba"]]}'><circle cx="392.3" cy="176.2" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Text-to-Scene", "0.509"], ["cost per case", "$0.71"], ["provider", "Z.ai"]]}'><circle cx="464.3" cy="179.6" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Text-to-Scene", "0.425"], ["cost per case", "$0.20"], ["provider", "Thinking Machines"]]}'><circle cx="344.4" cy="220.4" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Text-to-Scene", "0.243"], ["cost per case", "$0.19"], ["provider", "DeepSeek"]]}'><circle cx="340.3" cy="308.8" r="5.5" fill="#06b6d4" stroke="#fff" stroke-width="1.5"/></g><text x="763.8" y="48.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="621.1" y="87.5" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="584.3" y="127.7" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="267.5" y="117.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="145.8" y="186.1" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="96.9" y="225.9" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="794.2" y="63.2" text-anchor="middle" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="845.1" y="82.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="646.8" y="155.5" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text><text x="439.1" y="160.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="402.3" y="180.2" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="474.3" y="183.6" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="354.4" y="224.4" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="350.3" y="312.8" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text></g><g data-view="i2s" style="display:none"><line class="grid" x1="52" x2="880" y1="325.7" y2="325.7"/><text x="44" y="329.7" text-anchor="end" class="m num">0.10</text><line class="grid" x1="52" x2="880" y1="269.0" y2="269.0"/><text x="44" y="273.0" text-anchor="end" class="m num">0.20</text><line class="grid" x1="52" x2="880" y1="212.3" y2="212.3"/><text x="44" y="216.3" text-anchor="end" class="m num">0.30</text><line class="grid" x1="52" x2="880" y1="155.7" y2="155.7"/><text x="44" y="159.7" text-anchor="end" class="m num">0.40</text><line class="grid" x1="52" x2="880" y1="99.0" y2="99.0"/><text x="44" y="103.0" text-anchor="end" class="m num">0.50</text><line class="grid" x1="52" x2="880" y1="42.3" y2="42.3"/><text x="44" y="46.3" text-anchor="end" class="m num">0.60</text><text x="171.1" y="372" text-anchor="middle" class="m num">$0.03</text><line x1="171.1" x2="171.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="327.1" y="372" text-anchor="middle" class="m num">$0.1</text><line x1="327.1" x2="327.1" y1="354" y2="358" stroke="var(--line-strong)"/><text x="469.4" y="372" text-anchor="middle" class="m num">$0.3</text><line x1="469.4" x2="469.4" y1="354" y2="358" stroke="var(--line-strong)"/><text x="625.4" y="372" text-anchor="middle" class="m num">$1</text><line x1="625.4" x2="625.4" y1="354" y2="358" stroke="var(--line-strong)"/><text x="767.7" y="372" text-anchor="middle" class="m num">$3</text><line x1="767.7" x2="767.7" y1="354" y2="358" stroke="var(--line-strong)"/><line class="axis" x1="52" x2="880" y1="354" y2="354"/><path class="band" d="M112.9,317.2 L164.2,317.2 L164.2,310.9 L247.8,310.9 L247.8,263.3 L284.1,263.3 L284.1,179.5 L664.5,179.5 L664.5,53.1 L880.0,53.1 L880,354 L112.9,354 Z"/><path class="frontier" d="M112.9,317.2 L164.2,317.2 L164.2,310.9 L247.8,310.9 L247.8,263.3 L284.1,263.3 L284.1,179.5 L664.5,179.5 L664.5,53.1 L880.0,53.1"/><g class="pt" data-tip='{"t": "Gemini 3.8 Flash (high)", "r": [["Image-to-Scene", "0.581"], ["cost per case", "$1.35"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="664.5" cy="53.1" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Muse Spark 1.3 (medium)", "r": [["Image-to-Scene", "0.358"], ["cost per case", "$0.07"], ["provider", "Meta"], ["", "on the frontier"]]}'><circle cx="284.1" cy="179.5" r="7" fill="#8b5cf6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "DeepSeek V4.1 Flash (high)", "r": [["Image-to-Scene", "0.210"], ["cost per case", "$0.05"], ["provider", "DeepSeek"], ["", "on the frontier"]]}'><circle cx="247.8" cy="263.3" r="7" fill="#06b6d4" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking on)", "r": [["Image-to-Scene", "0.126"], ["cost per case", "$0.03"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="164.2" cy="310.9" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "Gemma 4 31B (thinking off)", "r": [["Image-to-Scene", "0.115"], ["cost per case", "$0.02"], ["provider", "Google"], ["", "on the frontier"]]}'><circle cx="112.9" cy="317.2" r="7" fill="#3b82f6" stroke="var(--text-h)" stroke-width="2"/></g><g class="pt" data-tip='{"t": "GPT-6 Astra (max)", "r": [["Image-to-Scene", "0.515"], ["cost per case", "$3.32"], ["provider", "OpenAI"]]}'><circle cx="780.9" cy="90.5" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Opus 5 (max)", "r": [["Image-to-Scene", "0.468"], ["cost per case", "$4.46"], ["provider", "Anthropic"]]}'><circle cx="819.1" cy="117.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Claude Fable 5.1 (max)", "r": [["Image-to-Scene", "0.424"], ["cost per case", "$3.09"], ["provider", "Anthropic"]]}'><circle cx="771.5" cy="142.1" r="5.5" fill="#c2410c" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GPT-5.6 Sol (high)", "r": [["Image-to-Scene", "0.393"], ["cost per case", "$1.88"], ["provider", "OpenAI"]]}'><circle cx="707.0" cy="159.6" r="5.5" fill="#0f9f6e" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "GLM-5.3 Flash (max)", "r": [["Image-to-Scene", "0.320"], ["cost per case", "$0.09"], ["provider", "Z.ai"]]}'><circle cx="316.4" cy="201.0" r="5.5" fill="#475569" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking on)", "r": [["Image-to-Scene", "0.226"], ["cost per case", "$0.26"], ["provider", "Alibaba"]]}'><circle cx="451.2" cy="254.3" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Qwen 3.8 27B (thinking off)", "r": [["Image-to-Scene", "0.200"], ["cost per case", "$0.28"], ["provider", "Alibaba"]]}'><circle cx="459.0" cy="269.0" r="5.5" fill="#f59e0b" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Inkling (high)", "r": [["Image-to-Scene", "0.198"], ["cost per case", "$0.75"], ["provider", "Thinking Machines"]]}'><circle cx="588.9" cy="270.1" r="5.5" fill="#a16207" stroke="#fff" stroke-width="1.5"/></g><g class="pt" data-tip='{"t": "Grok 4.6 (high)", "r": [["Image-to-Scene", "0.184"], ["cost per case", "$0.26"], ["provider", "xAI"]]}'><circle cx="452.6" cy="278.1" r="5.5" fill="#e11d48" stroke="#fff" stroke-width="1.5"/></g><text x="654.5" y="57.1" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemini</text><text x="274.1" y="183.5" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Muse</text><text x="237.8" y="267.3" text-anchor="end" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">DeepSeek</text><text x="164.2" y="298.9" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma on</text><text x="112.9" y="337.2" text-anchor="middle" class="b" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Gemma off</text><text x="790.9" y="94.5" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Astra</text><text x="829.1" y="121.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Opus</text><text x="781.5" y="146.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Fable</text><text x="717.0" y="163.6" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Sol</text><text x="326.4" y="205.0" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">GLM</text><text x="461.2" y="258.3" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen on</text><text x="469.0" y="273.0" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Qwen off</text><text x="598.9" y="274.1" text-anchor="start" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Inkling</text><text x="442.6" y="282.1" text-anchor="end" class="" style="font-size:12px;paint-order:stroke;stroke:#fff;stroke-width:3.5px;stroke-linejoin:round;pointer-events:none">Grok</text></g><text x="466.0" y="396" text-anchor="middle" class="m">estimated cost per case (US$, log scale)</text><text x="14" y="184.0" text-anchor="middle" class="m" transform="rotate(-90 14 184.0)">score</text></svg> | |
| <p class="note">Cost is the mean reported cost of one run, estimated from its token usage at the provider's list price (paper Figure 1b; provisional).</p></div> | |
| <div class="card" style="padding:1.4rem 1.5rem 1.2rem"><div class="sub-title">Ranking</div><div data-view="overall"><p class="board-note" style="margin:0 .2rem .7rem">Overall = ½ Text-to-Scene + ½ Image-to-Scene over the 95 public cases; its cost is weighted the same way.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="sm" data-best="high" class=sorted>Overall</th><th data-k="st" data-best="high">Text-to-Scene</th><th data-k="si" data-best="high">Image-to-Scene</th><th data-k="c_all" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.619"><div class="cellbar"><i style="width:80.0px;--bar:var(--primary)"></i><b>0.619</b></div></td><td data-v="0.724" class="dim">0.724</td><td data-v="0.515" class="dim">0.515</td><td data-v="12.896991822966507" class="dim">$12.90</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-2)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-2" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.619"><div class="cellbar"><i style="width:80.0px;--bar:var(--primary)"></i><b>0.619</b></div></td><td data-v="0.657" class="dim">0.657</td><td data-v="0.581" class="dim">0.581</td><td data-v="1.9235185771258503" class="dim">$1.92</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="org">Anthropic</span></td><td data-v="0.606"><div class="cellbar"><i style="width:78.3px;--bar:var(--primary)"></i><b>0.606</b></div></td><td data-v="0.788" class="dim">0.788</td><td data-v="0.424" class="dim">0.424</td><td data-v="10.623258766403161" class="dim">$10.62</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.593"><div class="cellbar"><i style="width:76.6px;--bar:var(--primary)"></i><b>0.593</b></div></td><td data-v="0.718" class="dim">0.718</td><td data-v="0.468" class="dim">0.468</td><td data-v="19.47789116793412" class="dim">$19.48</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="org">OpenAI</span></td><td data-v="0.55"><div class="cellbar"><i style="width:71.1px;--bar:var(--primary)"></i><b>0.550</b></div></td><td data-v="0.707" class="dim">0.707</td><td data-v="0.393" class="dim">0.393</td><td data-v="2.9749956842592593" class="dim">$2.97</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.502"><div class="cellbar"><i style="width:64.9px;--bar:var(--primary)"></i><b>0.502</b></div></td><td data-v="0.646" class="dim">0.646</td><td data-v="0.358" class="dim">0.358</td><td data-v="0.0861066423076923" class="dim">$0.09</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.415"><div class="cellbar"><i style="width:53.6px;--bar:var(--primary)"></i><b>0.415</b></div></td><td data-v="0.509" class="dim">0.509</td><td data-v="0.32" class="dim">0.320</td><td data-v="0.40130584861111107" class="dim">$0.40</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.378"><div class="cellbar"><i style="width:48.9px;--bar:var(--primary)"></i><b>0.378</b></div></td><td data-v="0.557" class="dim">0.557</td><td data-v="0.2" class="dim">0.200</td><td data-v="0.38413493183103564" class="dim">$0.38</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.376"><div class="cellbar"><i style="width:48.6px;--bar:var(--primary)"></i><b>0.376</b></div></td><td data-v="0.567" class="dim">0.567</td><td data-v="0.184" class="dim">0.184</td><td data-v="2.2948689296296294" class="dim">$2.29</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.371"><div class="cellbar"><i style="width:47.9px;--bar:var(--primary)"></i><b>0.371</b></div></td><td data-v="0.516" class="dim">0.516</td><td data-v="0.226" class="dim">0.226</td><td data-v="0.29748765575757574" class="dim">$0.30</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg> | |
| </span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.312"><div class="cellbar"><i style="width:40.3px;--bar:var(--primary)"></i><b>0.312</b></div></td><td data-v="0.425" class="dim">0.425</td><td data-v="0.198" class="dim">0.198</td><td data-v="0.4783280191269841" class="dim">$0.48</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-12)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-12" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.298"><div class="cellbar"><i style="width:38.5px;--bar:var(--primary)"></i><b>0.298</b></div></td><td data-v="0.471" class="dim">0.471</td><td data-v="0.126" class="dim">0.126</td><td data-v="0.026867125396825398" class="dim">$0.03</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-13)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-13" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.285"><div class="cellbar"><i style="width:36.8px;--bar:var(--primary)"></i><b>0.285</b></div></td><td data-v="0.455" class="dim">0.455</td><td data-v="0.115" class="dim">0.115</td><td data-v="0.017148714965986397" class="dim">$0.02</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="org">DeepSeek</span></td><td data-v="0.227"><div class="cellbar"><i style="width:29.3px;--bar:var(--primary)"></i><b>0.227</b></div></td><td data-v="0.243" class="dim">0.243</td><td data-v="0.21" class="dim">0.210</td><td data-v="0.1240297601010101" class="dim">$0.12</td></tr></tbody></table></div></div><div data-view="t2s" style="display:none"><p class="board-note" style="margin:0 .2rem .7rem">20 public cases. Case score = 0.2 × Detailed + 0.6 × Overview + 0.2 × Physical. Detailed and Overview are means of the per-case scores.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="st" data-best="high" class=sorted>Score</th><th data-k="detailed" data-best="high">Detailed</th><th data-k="overview" data-best="high">Overview</th><th data-k="pt" data-best="high">Physical</th><th data-k="c_t2s" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="tag front">Pareto</span><span class="org">Anthropic</span></td><td data-v="0.788"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-a)"></i><b>0.788</b></div></td><td data-v="0.7253149999999999" class="dim">0.725</td><td data-v="0.7717050000000001" class="dim">0.772</td><td data-v="0.898" class="dim">0.898</td><td data-v="18.1576316" class="dim">$18.16</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.724"><div class="cellbar"><i style="width:73.5px;--bar:var(--c4s-a)"></i><b>0.724</b></div></td><td data-v="0.707165" class="dim">0.707</td><td data-v="0.733235" class="dim">0.733</td><td data-v="0.712" class="dim">0.712</td><td data-v="22.472260736842106" class="dim">$22.47</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.718"><div class="cellbar"><i style="width:72.9px;--bar:var(--c4s-a)"></i><b>0.718</b></div></td><td data-v="0.63106" class="dim">0.631</td><td data-v="0.71617" class="dim">0.716</td><td data-v="0.811" class="dim">0.811</td><td data-v="34.49611078947368" class="dim">$34.50</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="tag front">Pareto</span><span class="org">OpenAI</span></td><td data-v="0.707"><div class="cellbar"><i style="width:71.8px;--bar:var(--c4s-a)"></i><b>0.707</b></div></td><td data-v="0.63186" class="dim">0.632</td><td data-v="0.710485" class="dim">0.710</td><td data-v="0.772" class="dim">0.772</td><td data-v="4.07260365" class="dim">$4.07</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-19)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-19" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.657"><div class="cellbar"><i style="width:66.7px;--bar:var(--c4s-a)"></i><b>0.657</b></div></td><td data-v="0.6369100000000001" class="dim">0.637</td><td data-v="0.66406" class="dim">0.664</td><td data-v="0.655" class="dim">0.655</td><td data-v="2.49471265" class="dim">$2.49</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.646"><div class="cellbar"><i style="width:65.6px;--bar:var(--c4s-a)"></i><b>0.646</b></div></td><td data-v="0.5981099999999999" class="dim">0.598</td><td data-v="0.660675" class="dim">0.661</td><td data-v="0.651" class="dim">0.651</td><td data-v="0.10048539999999999" class="dim">$0.10</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.567"><div class="cellbar"><i style="width:57.6px;--bar:var(--c4s-a)"></i><b>0.567</b></div></td><td data-v="0.52211" class="dim">0.522</td><td data-v="0.5764199999999999" class="dim">0.576</td><td data-v="0.585" class="dim">0.585</td><td data-v="4.326270533333333" class="dim">$4.33</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.557"><div class="cellbar"><i style="width:56.5px;--bar:var(--c4s-a)"></i><b>0.557</b></div></td><td data-v="0.506755" class="dim">0.507</td><td data-v="0.529525" class="dim">0.530</td><td data-v="0.688" class="dim">0.688</td><td data-v="0.49154169999999997" class="dim">$0.49</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.516"><div class="cellbar"><i style="width:52.4px;--bar:var(--c4s-a)"></i><b>0.516</b></div></td><td data-v="0.50522" class="dim">0.505</td><td data-v="0.45978" class="dim">0.460</td><td data-v="0.694" class="dim">0.694</td><td data-v="0.3344125" class="dim">$0.33</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.509"><div class="cellbar"><i style="width:51.7px;--bar:var(--c4s-a)"></i><b>0.509</b></div></td><td data-v="0.403365" class="dim">0.403</td><td data-v="0.537015" class="dim">0.537</td><td data-v="0.533" class="dim">0.533</td><td data-v="0.710521125" class="dim">$0.71</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-25)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-25" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.471"><div class="cellbar"><i style="width:47.8px;--bar:var(--c4s-a)"></i><b>0.471</b></div></td><td data-v="0.4117" class="dim">0.412</td><td data-v="0.41593" class="dim">0.416</td><td data-v="0.694" class="dim">0.694</td><td data-v="0.0253001" class="dim">$0.03</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-26)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-26" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.455"><div class="cellbar"><i style="width:46.2px;--bar:var(--c4s-a)"></i><b>0.455</b></div></td><td data-v="0.43810000000000004" class="dim">0.438</td><td data-v="0.370465" class="dim">0.370</td><td data-v="0.725" class="dim">0.725</td><td data-v="0.0151612" class="dim">$0.02</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg> | |
| </span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.425"><div class="cellbar"><i style="width:43.1px;--bar:var(--c4s-a)"></i><b>0.425</b></div></td><td data-v="0.392605" class="dim">0.393</td><td data-v="0.336705" class="dim">0.337</td><td data-v="0.722" class="dim">0.722</td><td data-v="0.20252835" class="dim">$0.20</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="org">DeepSeek</span></td><td data-v="0.243"><div class="cellbar"><i style="width:24.7px;--bar:var(--c4s-a)"></i><b>0.243</b></div></td><td data-v="0.216595" class="dim">0.217</td><td data-v="0.16134500000000002" class="dim">0.161</td><td data-v="0.513" class="dim">0.513</td><td data-v="0.193865" class="dim">$0.19</td></tr></tbody></table></div></div><div data-view="i2s" style="display:none"><p class="board-note" style="margin:0 .2rem .7rem">75 public cases (25 indoor, 50 outdoor). Case score = 0.8 × Repair F1 + 0.2 × Physical. Repair F1 counts target actors restored to the withheld ground truth.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th data-k="si" data-best="high" class=sorted>Score</th><th data-k="f1" data-best="high">Repair F1</th><th data-k="pi" data-best="high">Physical</th><th data-k="indoor" data-best="high">Indoor</th><th data-k="outdoor" data-best="high">Outdoor</th><th data-k="c_i2s" data-best="low">Cost / case</th></tr></thead><tbody><tr><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-29)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-29" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.581"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-b)"></i><b>0.581</b></div></td><td data-v="0.527" class="dim">0.527</td><td data-v="0.796" class="dim">0.796</td><td data-v="0.71653332" class="dim">0.717</td><td data-v="0.5133234200000001" class="dim">0.513</td><td data-v="1.3523245042517007" class="dim">$1.35</td></tr><tr><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.515"><div class="cellbar"><i style="width:70.9px;--bar:var(--c4s-b)"></i><b>0.515</b></div></td><td data-v="0.445" class="dim">0.445</td><td data-v="0.796" class="dim">0.796</td><td data-v="0.78546656" class="dim">0.785</td><td data-v="0.37954258" class="dim">0.380</td><td data-v="3.3217229090909095" class="dim">$3.32</td></tr><tr><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.468"><div class="cellbar"><i style="width:64.4px;--bar:var(--c4s-b)"></i><b>0.468</b></div></td><td data-v="0.389" class="dim">0.389</td><td data-v="0.786" class="dim">0.786</td><td data-v="0.61843384" class="dim">0.618</td><td data-v="0.39293306" class="dim">0.393</td><td data-v="4.459671546394558" class="dim">$4.46</td></tr><tr><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="org">Anthropic</span></td><td data-v="0.424"><div class="cellbar"><i style="width:58.4px;--bar:var(--c4s-b)"></i><b>0.424</b></div></td><td data-v="0.332" class="dim">0.332</td><td data-v="0.795" class="dim">0.795</td><td data-v="0.53523332" class="dim">0.535</td><td data-v="0.36890528000000006" class="dim">0.369</td><td data-v="3.0888859328063245" class="dim">$3.09</td></tr><tr><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="org">OpenAI</span></td><td data-v="0.393"><div class="cellbar"><i style="width:54.1px;--bar:var(--c4s-b)"></i><b>0.393</b></div></td><td data-v="0.319" class="dim">0.319</td><td data-v="0.689" class="dim">0.689</td><td data-v="0.49742972" class="dim">0.497</td><td data-v="0.34072354" class="dim">0.341</td><td data-v="1.8773877185185188" class="dim">$1.88</td></tr><tr><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.358"><div class="cellbar"><i style="width:49.3px;--bar:var(--c4s-b)"></i><b>0.358</b></div></td><td data-v="0.246" class="dim">0.246</td><td data-v="0.807" class="dim">0.807</td><td data-v="0.63253332" class="dim">0.633</td><td data-v="0.22105694" class="dim">0.221</td><td data-v="0.07172788461538461" class="dim">$0.07</td></tr><tr><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.32"><div class="cellbar"><i style="width:44.1px;--bar:var(--c4s-b)"></i><b>0.320</b></div></td><td data-v="0.188" class="dim">0.188</td><td data-v="0.848" class="dim">0.848</td><td data-v="0.46533411999999996" class="dim">0.465</td><td data-v="0.24731454" class="dim">0.247</td><td data-v="0.09209057222222222" class="dim">$0.09</td></tr><tr><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.226"><div class="cellbar"><i style="width:31.1px;--bar:var(--c4s-b)"></i><b>0.226</b></div></td><td data-v="0.118" class="dim">0.118</td><td data-v="0.66" class="dim">0.660</td><td data-v="0.29651112" class="dim">0.297</td><td data-v="0.19101142" class="dim">0.191</td><td data-v="0.2605628115151515" class="dim">$0.26</td></tr><tr><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">DeepSeek</span></td><td data-v="0.21"><div class="cellbar"><i style="width:28.9px;--bar:var(--c4s-b)"></i><b>0.210</b></div></td><td data-v="0.066" class="dim">0.066</td><td data-v="0.787" class="dim">0.787</td><td data-v="0.18933412" class="dim">0.189</td><td data-v="0.22106668" class="dim">0.221</td><td data-v="0.054194520202020195" class="dim">$0.05</td></tr><tr><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.2"><div class="cellbar"><i style="width:27.5px;--bar:var(--c4s-b)"></i><b>0.200</b></div></td><td data-v="0.083" class="dim">0.083</td><td data-v="0.667" class="dim">0.667</td><td data-v="0.26629816" class="dim">0.266</td><td data-v="0.166406" class="dim">0.166</td><td data-v="0.27672816366207137" class="dim">$0.28</td></tr><tr><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="currentColor" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect x="4.2" y="4.2" width="15.6" height="15.6" rx="3.6"/></svg> | |
| </span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.198"><div class="cellbar"><i style="width:27.3px;--bar:var(--c4s-b)"></i><b>0.198</b></div></td><td data-v="0.095" class="dim">0.095</td><td data-v="0.609" class="dim">0.609</td><td data-v="0.1690288" class="dim">0.169</td><td data-v="0.21251522" class="dim">0.213</td><td data-v="0.7541276882539681" class="dim">$0.75</td></tr><tr><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.184"><div class="cellbar"><i style="width:25.3px;--bar:var(--c4s-b)"></i><b>0.184</b></div></td><td data-v="0.044" class="dim">0.044</td><td data-v="0.744" class="dim">0.744</td><td data-v="0.1968008" class="dim">0.197</td><td data-v="0.17780978" class="dim">0.178</td><td data-v="0.2634673259259259" class="dim">$0.26</td></tr><tr><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-41)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-41" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.126"><div class="cellbar"><i style="width:17.3px;--bar:var(--c4s-b)"></i><b>0.126</b></div></td><td data-v="0.003" class="dim">0.003</td><td data-v="0.615" class="dim">0.615</td><td data-v="0.12704028" class="dim">0.127</td><td data-v="0.1247901" class="dim">0.125</td><td data-v="0.028434150793650796" class="dim">$0.03</td></tr><tr><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-42)" fill-rule="evenodd" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><linearGradient id="c4sGem-42" x1="0" y1="0" x2="1" y2="1"><stop offset="0" stop-color="#4796E3"/><stop offset=".55" stop-color="#9168C0"/><stop offset="1" stop-color="#D96570"/></linearGradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.115"><div class="cellbar"><i style="width:15.8px;--bar:var(--c4s-b)"></i><b>0.115</b></div></td><td data-v="0.001" class="dim">0.001</td><td data-v="0.572" class="dim">0.572</td><td data-v="0.11239600000000001" class="dim">0.112</td><td data-v="0.11635892" class="dim">0.116</td><td data-v="0.01913622993197279" class="dim">$0.02</td></tr></tbody></table></div></div> | |
| <p class="board-note">Click a column to sort. Pareto: on the score-against-cost frontier.</p></div></div> | |
| </div></section><section class="alt" id="takeaways"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Findings</span><h2 class="section-title">Takeaways</h2> | |
| <p class="section-desc">What the evaluation shows across the 14 agents. Every chart below is drawn from the paper's numbers; hover for values.</p></div> | |
| <div class="tk"><span class="n">Takeaway 1</span><h3>Construction and editing probe different capabilities: scene-level spatial reasoning and precise control of scene state.</h3><p class="s">Despite nearly identical overall scores, Astra is stronger at construction and Gemini at editing.</p><div class="figs"><figure><div class="ch-legend"><span><i style="background:var(--c4s-a)"></i>Text-to-Scene (construction)</span><span><i style="background:var(--c4s-b)"></i>Image-to-Scene (editing)</span></div><svg class="ch" viewBox="0 0 880 416" role="img" aria-label="Text-to-Scene and Image-to-Scene score per agent"><text x="290.0" y="16.0" text-anchor="end" class="b" >← Text-to-Scene</text><text x="590.0" y="16.0" text-anchor="start" class="b" >Image-to-Scene →</text><g class="row" data-tip="GPT-6 Astra (max): Text-to-Scene 0.724 · Image-to-Scene 0.515 · overall 0.619"><rect x="72.8" y="35" width="217.2" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="35" width="154.5" height="17" rx="3" fill="var(--c4s-b)"/><text x="66.8" y="47.5" text-anchor="end" class="num b" >0.724</text><text x="750.5" y="47.5" text-anchor="start" class="num b" >0.515</text><text x="440.0" y="47.5" text-anchor="middle" class="b" >GPT-6 Astra</text></g><g class="row" data-tip="Gemini 3.8 Flash (high): Text-to-Scene 0.657 · Image-to-Scene 0.581 · overall 0.619"><rect x="92.9" y="62" width="197.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="62" width="174.3" height="17" rx="3" fill="var(--c4s-b)"/><text x="86.9" y="74.5" text-anchor="end" class="num b" >0.657</text><text x="770.3" y="74.5" text-anchor="start" class="num b" >0.581</text><text x="440.0" y="74.5" text-anchor="middle" class="b" >Gemini 3.8 Flash</text></g><g class="row dim" data-tip="Claude Fable 5.1 (max): Text-to-Scene 0.788 · Image-to-Scene 0.424 · overall 0.606"><rect x="53.6" y="89" width="236.4" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="89" width="127.2" height="17" rx="3" fill="var(--c4s-b)"/><text x="47.6" y="101.5" text-anchor="end" class="num" >0.788</text><text x="723.2" y="101.5" text-anchor="start" class="num" >0.424</text><text x="440.0" y="101.5" text-anchor="middle" class="" >Claude Fable 5.1</text></g><g class="row dim" data-tip="Claude Opus 5 (max): Text-to-Scene 0.718 · Image-to-Scene 0.468 · overall 0.593"><rect x="74.6" y="116" width="215.4" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="116" width="140.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="68.6" y="128.5" text-anchor="end" class="num" >0.718</text><text x="736.4" y="128.5" text-anchor="start" class="num" >0.468</text><text x="440.0" y="128.5" text-anchor="middle" class="" >Claude Opus 5</text></g><g class="row dim" data-tip="GPT-5.6 Sol (high): Text-to-Scene 0.707 · Image-to-Scene 0.393 · overall 0.550"><rect x="77.9" y="143" width="212.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="143" width="117.9" height="17" rx="3" fill="var(--c4s-b)"/><text x="71.9" y="155.5" text-anchor="end" class="num" >0.707</text><text x="713.9" y="155.5" text-anchor="start" class="num" >0.393</text><text x="440.0" y="155.5" text-anchor="middle" class="" >GPT-5.6 Sol</text></g><g class="row dim" data-tip="Muse Spark 1.3 (medium): Text-to-Scene 0.646 · Image-to-Scene 0.358 · overall 0.502"><rect x="96.2" y="170" width="193.8" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="170" width="107.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="90.2" y="182.5" text-anchor="end" class="num" >0.646</text><text x="703.4" y="182.5" text-anchor="start" class="num" >0.358</text><text x="440.0" y="182.5" text-anchor="middle" class="" >Muse Spark 1.3</text></g><g class="row dim" data-tip="GLM-5.3 Flash (max): Text-to-Scene 0.509 · Image-to-Scene 0.320 · overall 0.415"><rect x="137.3" y="197" width="152.7" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="197" width="96.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="131.3" y="209.5" text-anchor="end" class="num" >0.509</text><text x="692.0" y="209.5" text-anchor="start" class="num" >0.320</text><text x="440.0" y="209.5" text-anchor="middle" class="" >GLM-5.3 Flash</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking off): Text-to-Scene 0.557 · Image-to-Scene 0.200 · overall 0.378"><rect x="122.9" y="224" width="167.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="224" width="60.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="116.9" y="236.5" text-anchor="end" class="num" >0.557</text><text x="656.0" y="236.5" text-anchor="start" class="num" >0.200</text><text x="440.0" y="236.5" text-anchor="middle" class="" >Qwen 3.8 27B · off</text></g><g class="row dim" data-tip="Grok 4.6 (high): Text-to-Scene 0.567 · Image-to-Scene 0.184 · overall 0.376"><rect x="119.9" y="251" width="170.1" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="251" width="55.2" height="17" rx="3" fill="var(--c4s-b)"/><text x="113.9" y="263.5" text-anchor="end" class="num" >0.567</text><text x="651.2" y="263.5" text-anchor="start" class="num" >0.184</text><text x="440.0" y="263.5" text-anchor="middle" class="" >Grok 4.6</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking on): Text-to-Scene 0.516 · Image-to-Scene 0.226 · overall 0.371"><rect x="135.2" y="278" width="154.8" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="278" width="67.8" height="17" rx="3" fill="var(--c4s-b)"/><text x="129.2" y="290.5" text-anchor="end" class="num" >0.516</text><text x="663.8" y="290.5" text-anchor="start" class="num" >0.226</text><text x="440.0" y="290.5" text-anchor="middle" class="" >Qwen 3.8 27B · on</text></g><g class="row dim" data-tip="Inkling (high): Text-to-Scene 0.425 · Image-to-Scene 0.198 · overall 0.312"><rect x="162.5" y="305" width="127.5" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="305" width="59.4" height="17" rx="3" fill="var(--c4s-b)"/><text x="156.5" y="317.5" text-anchor="end" class="num" >0.425</text><text x="655.4" y="317.5" text-anchor="start" class="num" >0.198</text><text x="440.0" y="317.5" text-anchor="middle" class="" >Inkling</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking on): Text-to-Scene 0.471 · Image-to-Scene 0.126 · overall 0.298"><rect x="148.7" y="332" width="141.3" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="332" width="37.8" height="17" rx="3" fill="var(--c4s-b)"/><text x="142.7" y="344.5" text-anchor="end" class="num" >0.471</text><text x="633.8" y="344.5" text-anchor="start" class="num" >0.126</text><text x="440.0" y="344.5" text-anchor="middle" class="" >Gemma 4 31B · on</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking off): Text-to-Scene 0.455 · Image-to-Scene 0.115 · overall 0.285"><rect x="153.5" y="359" width="136.5" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="359" width="34.5" height="17" rx="3" fill="var(--c4s-b)"/><text x="147.5" y="371.5" text-anchor="end" class="num" >0.455</text><text x="630.5" y="371.5" text-anchor="start" class="num" >0.115</text><text x="440.0" y="371.5" text-anchor="middle" class="" >Gemma 4 31B · off</text></g><g class="row dim" data-tip="DeepSeek V4.1 Flash (high): Text-to-Scene 0.243 · Image-to-Scene 0.210 · overall 0.227"><rect x="217.1" y="386" width="72.9" height="17" rx="3" fill="var(--c4s-a)"/><rect x="590.0" y="386" width="63.0" height="17" rx="3" fill="var(--c4s-b)"/><text x="211.1" y="398.5" text-anchor="end" class="num" >0.243</text><text x="659.0" y="398.5" text-anchor="start" class="num" >0.210</text><text x="440.0" y="398.5" text-anchor="middle" class="" >DeepSeek V4.1 Flash</text></g></svg><figcaption>Text-to-Scene (left) and Image-to-Scene (right) score per agent, in overall order (paper Table 2). Astra and Gemini tie at 0.619 overall.</figcaption></figure></div></div><div class="tk"><span class="n">Takeaway 2</span><h3>Spatial Composition remains the weakest requirement family for all 14 agents.</h3><p class="s">Errors persist even when the required objects are present: generating the right objects does not ensure that their relationships satisfy the specification.</p><div class="figs"><figure><div class="fh">Requirement-family score per agent</div><div class="ch-legend"><span><i style="background:var(--c4s-g1)"></i>Identity & Environment</span><span><i style="background:var(--c4s-g2)"></i>Content & Quantity</span><span><i style="background:var(--c4s-g3)"></i>Attributes & Materials</span><span><i style="background:var(--c4s-hot)"></i>Spatial Composition</span></div><svg class="ch" viewBox="0 0 880 450" role="img" aria-label="Requirement-family scores per agent"><line class="grid" x1="245.6" x2="245.6" y1="18" y2="416"/><text x="245.6" y="432.0" text-anchor="middle" class="m num" >0.2</text><line class="grid" x1="396.7" x2="396.7" y1="18" y2="416"/><text x="396.7" y="432.0" text-anchor="middle" class="m num" >0.4</text><line class="grid" x1="547.8" x2="547.8" y1="18" y2="416"/><text x="547.8" y="432.0" text-anchor="middle" class="m num" >0.6</text><line class="grid" x1="698.9" x2="698.9" y1="18" y2="416"/><text x="698.9" y="432.0" text-anchor="middle" class="m num" >0.8</text><line class="grid" x1="850.0" x2="850.0" y1="18" y2="416"/><text x="850.0" y="432.0" text-anchor="middle" class="m num" >1.0</text><g class="row" data-tip="GPT-6 Astra: Identity & Environment 0.875 · Content & Quantity 0.715 · Spatial Composition 0.543 · Attributes & Materials 0.643"><text x="158.0" y="43.0" text-anchor="end" class="" >GPT-6 Astra</text><line x1="504.7" x2="755.6" y1="39.0" y2="39.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="755.6" cy="39.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="634.7" cy="39.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="580.3" cy="39.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="504.7" cy="39.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemini 3.8 Flash: Identity & Environment 0.814 · Content & Quantity 0.639 · Spatial Composition 0.473 · Attributes & Materials 0.572"><text x="158.0" y="69.0" text-anchor="end" class="" >Gemini 3.8 Flash</text><line x1="451.8" x2="709.5" y1="65.0" y2="65.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="709.5" cy="65.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="577.2" cy="65.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="526.6" cy="65.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="451.8" cy="65.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Claude Fable 5.1: Identity & Environment 0.906 · Content & Quantity 0.738 · Spatial Composition 0.538 · Attributes & Materials 0.670"><text x="158.0" y="95.0" text-anchor="end" class="" >Claude Fable 5.1</text><line x1="500.9" x2="779.0" y1="91.0" y2="91.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="779.0" cy="91.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="652.0" cy="91.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="600.7" cy="91.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="500.9" cy="91.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Claude Opus 5: Identity & Environment 0.803 · Content & Quantity 0.624 · Spatial Composition 0.479 · Attributes & Materials 0.573"><text x="158.0" y="121.0" text-anchor="end" class="" >Claude Opus 5</text><line x1="456.4" x2="701.2" y1="117.0" y2="117.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="701.2" cy="117.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="565.9" cy="117.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="527.4" cy="117.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="456.4" cy="117.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="GPT-5.6 Sol: Identity & Environment 0.750 · Content & Quantity 0.660 · Spatial Composition 0.469 · Attributes & Materials 0.602"><text x="158.0" y="147.0" text-anchor="end" class="" >GPT-5.6 Sol</text><line x1="448.8" x2="661.1" y1="143.0" y2="143.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="661.1" cy="143.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="593.1" cy="143.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="549.3" cy="143.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="448.8" cy="143.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Muse Spark 1.3: Identity & Environment 0.730 · Content & Quantity 0.641 · Spatial Composition 0.393 · Attributes & Materials 0.546"><text x="158.0" y="173.0" text-anchor="end" class="" >Muse Spark 1.3</text><line x1="391.4" x2="646.0" y1="169.0" y2="169.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="646.0" cy="169.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="578.8" cy="169.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="507.0" cy="169.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="391.4" cy="169.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="GLM-5.3 Flash: Identity & Environment 0.467 · Content & Quantity 0.421 · Spatial Composition 0.299 · Attributes & Materials 0.377"><text x="158.0" y="199.0" text-anchor="end" class="" >GLM-5.3 Flash</text><line x1="320.4" x2="447.3" y1="195.0" y2="195.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="447.3" cy="195.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="412.5" cy="195.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="379.3" cy="195.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="320.4" cy="195.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Qwen 3.8 27B · off: Identity & Environment 0.724 · Content & Quantity 0.520 · Spatial Composition 0.300 · Attributes & Materials 0.428"><text x="158.0" y="225.0" text-anchor="end" class="" >Qwen 3.8 27B · off</text><line x1="321.1" x2="641.5" y1="221.0" y2="221.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="641.5" cy="221.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="487.3" cy="221.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="417.8" cy="221.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="321.1" cy="221.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Grok 4.6: Identity & Environment 0.647 · Content & Quantity 0.558 · Spatial Composition 0.334 · Attributes & Materials 0.457"><text x="158.0" y="251.0" text-anchor="end" class="" >Grok 4.6</text><line x1="346.8" x2="583.3" y1="247.0" y2="247.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="583.3" cy="247.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="516.0" cy="247.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="439.7" cy="247.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="346.8" cy="247.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Qwen 3.8 27B · on: Identity & Environment 0.660 · Content & Quantity 0.525 · Spatial Composition 0.307 · Attributes & Materials 0.470"><text x="158.0" y="277.0" text-anchor="end" class="" >Qwen 3.8 27B · on</text><line x1="326.4" x2="593.1" y1="273.0" y2="273.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="593.1" cy="273.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="491.1" cy="273.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="449.6" cy="273.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="326.4" cy="273.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Inkling: Identity & Environment 0.572 · Content & Quantity 0.394 · Spatial Composition 0.193 · Attributes & Materials 0.361"><text x="158.0" y="303.0" text-anchor="end" class="" >Inkling</text><line x1="240.3" x2="526.6" y1="299.0" y2="299.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="526.6" cy="299.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="392.1" cy="299.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="367.2" cy="299.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="240.3" cy="299.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemma 4 31B · on: Identity & Environment 0.561 · Content & Quantity 0.407 · Spatial Composition 0.272 · Attributes & Materials 0.387"><text x="158.0" y="329.0" text-anchor="end" class="" >Gemma 4 31B · on</text><line x1="300.0" x2="518.3" y1="325.0" y2="325.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="518.3" cy="325.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="402.0" cy="325.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="386.8" cy="325.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="300.0" cy="325.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="Gemma 4 31B · off: Identity & Environment 0.612 · Content & Quantity 0.453 · Spatial Composition 0.252 · Attributes & Materials 0.387"><text x="158.0" y="355.0" text-anchor="end" class="" >Gemma 4 31B · off</text><line x1="284.8" x2="556.8" y1="351.0" y2="351.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="556.8" cy="351.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="436.7" cy="351.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="386.8" cy="351.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="284.8" cy="351.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><g class="row" data-tip="DeepSeek V4.1 Flash: Identity & Environment 0.294 · Content & Quantity 0.215 · Spatial Composition 0.120 · Attributes & Materials 0.259"><text x="158.0" y="381.0" text-anchor="end" class="" >DeepSeek V4.1 Flash</text><line x1="185.1" x2="316.6" y1="377.0" y2="377.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="316.6" cy="377.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="256.9" cy="377.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="290.1" cy="377.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="185.1" cy="377.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/></g><line class="axis" x1="10" x2="850" y1="390.0" y2="390.0"/><g class="row" data-tip="Mean of the 14 agents: Identity & Environment 0.672 · Content & Quantity 0.536 · Spatial Composition 0.355 · Attributes & Materials 0.481"><text x="158.0" y="407.0" text-anchor="end" class="b" >Mean of 14</text><line x1="362.8" x2="602.6" y1="403.0" y2="403.0" stroke="var(--line-strong)" stroke-width="2"/><circle cx="602.6" cy="403.0" r="6" fill="var(--c4s-g1)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="499.7" cy="403.0" r="6" fill="var(--c4s-g2)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="457.8" cy="403.0" r="6" fill="var(--c4s-g3)" stroke="var(--surface-1)" stroke-width="2"/><circle cx="362.8" cy="403.0" r="7" fill="var(--c4s-hot)" stroke="var(--surface-1)" stroke-width="2"/><text x="351.8" y="407.0" text-anchor="end" class="hot num" >0.36</text><text x="613.6" y="407.0" text-anchor="start" class="m num" >0.67</text></g></svg><figcaption>Each row is one agent's four family scores; the orange dot, Spatial Composition, is the lowest in every row (paper Figure 14b).</figcaption></figure><div class="figs two" style="margin-top:0"><figure><div class="fh">The objects are there; the relation is not</div><div class="ev"><img src="img/judge_egyptian-temple_sol_s3f_000025.jpg?v=1790731787" loading="lazy" alt="The judge's view of GPT-5.6 Sol's Egyptian Temple roof"><svg viewBox="0 0 1280 720" preserveAspectRatio="none" aria-hidden="true"><circle cx="848" cy="335" r="60" fill="none" stroke="#000" stroke-opacity=".55" stroke-width="11"/><circle cx="848" cy="335" r="60" fill="none" stroke="#ff6b4a" stroke-width="6"/><circle cx="626" cy="30" r="44" fill="none" stroke="#000" stroke-opacity=".55" stroke-width="11"/><circle cx="626" cy="30" r="44" fill="none" stroke="#ff6b4a" stroke-width="6"/></svg></div><div class="chips"><span class="chip ok">✓ slab roof <small>0.95</small></span><span class="chip ok">✓ stone coping <small>0.82</small></span><span class="chip no">✗ slab roof enclosed by the coping <small>0.78</small></span></div><figcaption>The judge's own frame of GPT-5.6 Sol on Egyptian Temple. It finds the slab roof and the stone coping, but not the roof enclosed by the coping: the coping is separate low wall segments with visible gaps (ringed).</figcaption></figure><figure><div class="fh">Mismatch rate when the required objects are present</div><svg class="ch" viewBox="0 0 440 144" role="img" aria-label="Mismatch rate when the required objects are present"><g data-tip="Spatial relation: 32.0% of checks fail although the objects are present"><text x="120.0" y="34.0" text-anchor="end" class="b" >Spatial relation</text><rect x="130" y="16" width="228.6" height="28" rx="4" fill="var(--c4s-hot)"/><text x="366.6" y="35.0" text-anchor="start" class="num hot" >32.0%</text></g><g data-tip="Distribution: 19.1% of checks fail although the objects are present"><text x="120.0" y="78.0" text-anchor="end" class="" >Distribution</text><rect x="130" y="60" width="136.4" height="28" rx="4" fill="var(--c4s-g1)"/><text x="274.4" y="79.0" text-anchor="start" class="num b" >19.1%</text></g><g data-tip="Composition: 4.3% of checks fail although the objects are present"><text x="120.0" y="122.0" text-anchor="end" class="" >Composition</text><rect x="130" y="104" width="30.7" height="28" rx="4" fill="var(--c4s-g1)"/><text x="168.7" y="123.0" text-anchor="start" class="num b" >4.3%</text></g></svg><figcaption>Across the benchmark (paper Figure 6a).</figcaption></figure></div></div></div><div class="tk"><span class="n">Takeaway 3</span><h3>Editing ability varies substantially across repair types.</h3><p class="s">Astra performs best on Transform repairs, while Gemini is stronger on Lifecycle and Layout operations.</p><div class="figs"><figure><svg class="ch" viewBox="0 0 720 298" role="img" aria-label="Mean Image-to-Scene score by repair type"><text x="184.0" y="20.0" text-anchor="middle" class="b" >GPT-6 Astra</text><text x="338.0" y="20.0" text-anchor="middle" class="b" >Gemini 3.8 Flash</text><text x="492.0" y="20.0" text-anchor="middle" class="b" >Claude Fable 5.1</text><text x="646.0" y="20.0" text-anchor="middle" class="b" >Claude Opus 5</text><text x="98.0" y="62.0" text-anchor="end" class="b" >Restore</text><g data-tip="Restore · GPT-6 Astra: 0.324"><rect x="110" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 46%, var(--surface-1))"/><text x="184.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.324</text></g><g data-tip="Restore · Gemini 3.8 Flash: 0.376"><rect x="264" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 51%, var(--surface-1))"/><text x="338.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.376</text></g><g data-tip="Restore · Claude Fable 5.1: 0.244"><rect x="418" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 37%, var(--surface-1))"/><text x="492.0" y="62.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.244</text></g><g data-tip="Restore · Claude Opus 5: 0.388 (best of the four)"><rect x="572" y="34" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 53%, var(--surface-1))"/><rect x="574" y="36" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="646.0" y="62.0" text-anchor="middle" class="num" style="font-weight:800;fill:var(--text-primary);font-size:15px">0.388</text></g><text x="98.0" y="114.0" text-anchor="end" class="b" >Lifecycle</text><g data-tip="Lifecycle · GPT-6 Astra: 0.577"><rect x="110" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 73%, var(--surface-1))"/><text x="184.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.577</text></g><g data-tip="Lifecycle · Gemini 3.8 Flash: 0.715 (best of the four)"><rect x="264" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 89%, var(--surface-1))"/><rect x="266" y="88" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="338.0" y="114.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.715</text></g><g data-tip="Lifecycle · Claude Fable 5.1: 0.554"><rect x="418" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))"/><text x="492.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.554</text></g><g data-tip="Lifecycle · Claude Opus 5: 0.593"><rect x="572" y="86" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 75%, var(--surface-1))"/><text x="646.0" y="114.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.593</text></g><text x="98.0" y="166.0" text-anchor="end" class="b" >Layout</text><g data-tip="Layout · GPT-6 Astra: 0.596"><rect x="110" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 76%, var(--surface-1))"/><text x="184.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.596</text></g><g data-tip="Layout · Gemini 3.8 Flash: 0.703 (best of the four)"><rect x="264" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 87%, var(--surface-1))"/><rect x="266" y="140" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="338.0" y="166.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.703</text></g><g data-tip="Layout · Claude Fable 5.1: 0.464"><rect x="418" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))"/><text x="492.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.464</text></g><g data-tip="Layout · Claude Opus 5: 0.512"><rect x="572" y="138" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 66%, var(--surface-1))"/><text x="646.0" y="166.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.512</text></g><text x="98.0" y="218.0" text-anchor="end" class="b" >Symmetry</text><g data-tip="Symmetry · GPT-6 Astra: 0.466"><rect x="110" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))"/><text x="184.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.466</text></g><g data-tip="Symmetry · Gemini 3.8 Flash: 0.544"><rect x="264" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 70%, var(--surface-1))"/><text x="338.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.544</text></g><g data-tip="Symmetry · Claude Fable 5.1: 0.555 (best of the four)"><rect x="418" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))"/><rect x="420" y="192" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="492.0" y="218.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.555</text></g><g data-tip="Symmetry · Claude Opus 5: 0.359"><rect x="572" y="190" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))"/><text x="646.0" y="218.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.359</text></g><text x="98.0" y="270.0" text-anchor="end" class="b" >Transform</text><g data-tip="Transform · GPT-6 Astra: 0.613 (best of the four)"><rect x="110" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 77%, var(--surface-1))"/><rect x="112" y="244" width="144" height="42" rx="5" fill="none" stroke="var(--c4s-hot)" stroke-width="3.5"/><text x="184.0" y="270.0" text-anchor="middle" class="num" style="font-weight:800;fill:#fff;font-size:15px">0.613</text></g><g data-tip="Transform · Gemini 3.8 Flash: 0.532"><rect x="264" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 69%, var(--surface-1))"/><text x="338.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:#fff;font-size:15px">0.532</text></g><g data-tip="Transform · Claude Fable 5.1: 0.353"><rect x="418" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))"/><text x="492.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.353</text></g><g data-tip="Transform · Claude Opus 5: 0.406"><rect x="572" y="242" width="148" height="46" rx="6" fill="color-mix(in oklab, var(--c4s-seq) 55%, var(--surface-1))"/><text x="646.0" y="270.0" text-anchor="middle" class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px">0.406</text></g></svg><figcaption>Mean Image-to-Scene score by repair type for four agents; the outlined cell is the best of the four in its row (paper Figure 6b).</figcaption></figure></div></div><div class="tk"><span class="n">Takeaway 4</span><h3>Recovering the target does not guarantee precise editing.</h3><p class="s">Across all 14 configurations, 35.8% of complete recoveries still contain unintended changes to the surrounding scene.</p><div class="figs"><figure><div class="bigstats"><div><b>1,050</b><span>Image-to-Scene evaluations (14 agents × 75 cases)</span></div><div><b style="color:var(--c4s-ok)">212</b><span>recovered every target completely</span></div><div><b style="color:var(--c4s-hot)">76 · 35.8%</b><span>of those still changed the surrounding scene</span></div></div><div class="ch-legend"><span><i style="background:var(--c4s-hot)"></i>unintended edits</span><span><i style="background:var(--c4s-ok)"></i>clean complete recovery</span><span><i style="background:var(--c4s-unit)"></i>no complete recovery</span></div><svg class="ch" viewBox="0 0 850 357" role="img" aria-label="1,050 evaluations, 212 complete recoveries, 76 with unintended edits"><g fill="var(--c4s-unit)" data-tip="838 evaluations without complete recovery"><circle cx="178.5" cy="42.5" r="6.2"/><circle cx="178.5" cy="59.5" r="6.2"/><circle cx="178.5" cy="76.5" r="6.2"/><circle cx="178.5" cy="93.5" r="6.2"/><circle cx="178.5" cy="110.5" r="6.2"/><circle cx="178.5" cy="127.5" r="6.2"/><circle cx="178.5" cy="144.5" r="6.2"/><circle cx="178.5" cy="161.5" r="6.2"/><circle cx="178.5" cy="178.5" r="6.2"/><circle cx="178.5" cy="195.5" r="6.2"/><circle cx="178.5" cy="212.5" r="6.2"/><circle cx="178.5" cy="229.5" r="6.2"/><circle cx="178.5" cy="246.5" r="6.2"/><circle cx="178.5" cy="263.5" r="6.2"/><circle cx="178.5" cy="280.5" r="6.2"/><circle cx="178.5" cy="297.5" r="6.2"/><circle cx="178.5" cy="314.5" r="6.2"/><circle cx="178.5" cy="331.5" r="6.2"/><circle cx="178.5" cy="348.5" r="6.2"/><circle cx="195.5" cy="8.5" r="6.2"/><circle cx="195.5" cy="25.5" r="6.2"/><circle cx="195.5" cy="42.5" r="6.2"/><circle cx="195.5" cy="59.5" r="6.2"/><circle cx="195.5" cy="76.5" r="6.2"/><circle cx="195.5" cy="93.5" r="6.2"/><circle cx="195.5" cy="110.5" r="6.2"/><circle cx="195.5" cy="127.5" r="6.2"/><circle cx="195.5" cy="144.5" r="6.2"/><circle cx="195.5" cy="161.5" r="6.2"/><circle cx="195.5" cy="178.5" r="6.2"/><circle cx="195.5" cy="195.5" r="6.2"/><circle cx="195.5" cy="212.5" r="6.2"/><circle cx="195.5" cy="229.5" r="6.2"/><circle cx="195.5" cy="246.5" r="6.2"/><circle cx="195.5" cy="263.5" r="6.2"/><circle cx="195.5" cy="280.5" r="6.2"/><circle cx="195.5" cy="297.5" r="6.2"/><circle cx="195.5" cy="314.5" r="6.2"/><circle cx="195.5" cy="331.5" r="6.2"/><circle cx="195.5" cy="348.5" r="6.2"/><circle cx="212.5" cy="8.5" r="6.2"/><circle cx="212.5" cy="25.5" r="6.2"/><circle cx="212.5" cy="42.5" r="6.2"/><circle cx="212.5" cy="59.5" r="6.2"/><circle cx="212.5" cy="76.5" r="6.2"/><circle cx="212.5" cy="93.5" r="6.2"/><circle cx="212.5" cy="110.5" r="6.2"/><circle cx="212.5" cy="127.5" r="6.2"/><circle cx="212.5" cy="144.5" r="6.2"/><circle cx="212.5" cy="161.5" r="6.2"/><circle cx="212.5" cy="178.5" r="6.2"/><circle cx="212.5" cy="195.5" r="6.2"/><circle cx="212.5" cy="212.5" r="6.2"/><circle cx="212.5" cy="229.5" r="6.2"/><circle cx="212.5" cy="246.5" r="6.2"/><circle cx="212.5" cy="263.5" r="6.2"/><circle cx="212.5" cy="280.5" r="6.2"/><circle cx="212.5" cy="297.5" r="6.2"/><circle cx="212.5" cy="314.5" r="6.2"/><circle cx="212.5" cy="331.5" r="6.2"/><circle cx="212.5" cy="348.5" r="6.2"/><circle cx="229.5" cy="8.5" r="6.2"/><circle cx="229.5" cy="25.5" r="6.2"/><circle cx="229.5" cy="42.5" r="6.2"/><circle cx="229.5" cy="59.5" r="6.2"/><circle cx="229.5" cy="76.5" r="6.2"/><circle cx="229.5" cy="93.5" r="6.2"/><circle cx="229.5" cy="110.5" r="6.2"/><circle cx="229.5" cy="127.5" r="6.2"/><circle cx="229.5" cy="144.5" r="6.2"/><circle cx="229.5" cy="161.5" r="6.2"/><circle cx="229.5" cy="178.5" r="6.2"/><circle cx="229.5" cy="195.5" r="6.2"/><circle cx="229.5" cy="212.5" r="6.2"/><circle cx="229.5" cy="229.5" r="6.2"/><circle cx="229.5" cy="246.5" r="6.2"/><circle cx="229.5" cy="263.5" r="6.2"/><circle cx="229.5" cy="280.5" r="6.2"/><circle cx="229.5" cy="297.5" r="6.2"/><circle cx="229.5" cy="314.5" r="6.2"/><circle cx="229.5" cy="331.5" r="6.2"/><circle cx="229.5" cy="348.5" r="6.2"/><circle cx="246.5" cy="8.5" r="6.2"/><circle cx="246.5" cy="25.5" r="6.2"/><circle cx="246.5" cy="42.5" r="6.2"/><circle cx="246.5" cy="59.5" r="6.2"/><circle cx="246.5" cy="76.5" r="6.2"/><circle cx="246.5" cy="93.5" r="6.2"/><circle cx="246.5" cy="110.5" r="6.2"/><circle cx="246.5" cy="127.5" r="6.2"/><circle cx="246.5" cy="144.5" r="6.2"/><circle cx="246.5" cy="161.5" r="6.2"/><circle cx="246.5" cy="178.5" r="6.2"/><circle cx="246.5" cy="195.5" r="6.2"/><circle cx="246.5" cy="212.5" r="6.2"/><circle cx="246.5" cy="229.5" r="6.2"/><circle cx="246.5" cy="246.5" r="6.2"/><circle cx="246.5" cy="263.5" r="6.2"/><circle cx="246.5" cy="280.5" r="6.2"/><circle cx="246.5" cy="297.5" r="6.2"/><circle cx="246.5" cy="314.5" r="6.2"/><circle cx="246.5" cy="331.5" r="6.2"/><circle cx="246.5" cy="348.5" r="6.2"/><circle cx="263.5" cy="8.5" r="6.2"/><circle cx="263.5" cy="25.5" r="6.2"/><circle cx="263.5" cy="42.5" r="6.2"/><circle cx="263.5" cy="59.5" r="6.2"/><circle cx="263.5" cy="76.5" r="6.2"/><circle cx="263.5" cy="93.5" r="6.2"/><circle cx="263.5" cy="110.5" r="6.2"/><circle cx="263.5" cy="127.5" r="6.2"/><circle cx="263.5" cy="144.5" r="6.2"/><circle cx="263.5" cy="161.5" r="6.2"/><circle cx="263.5" cy="178.5" r="6.2"/><circle cx="263.5" cy="195.5" r="6.2"/><circle cx="263.5" cy="212.5" r="6.2"/><circle cx="263.5" cy="229.5" r="6.2"/><circle cx="263.5" cy="246.5" r="6.2"/><circle cx="263.5" cy="263.5" r="6.2"/><circle cx="263.5" cy="280.5" r="6.2"/><circle cx="263.5" cy="297.5" r="6.2"/><circle cx="263.5" cy="314.5" r="6.2"/><circle cx="263.5" cy="331.5" r="6.2"/><circle cx="263.5" cy="348.5" r="6.2"/><circle cx="280.5" cy="8.5" r="6.2"/><circle cx="280.5" cy="25.5" r="6.2"/><circle cx="280.5" cy="42.5" r="6.2"/><circle cx="280.5" cy="59.5" r="6.2"/><circle cx="280.5" cy="76.5" r="6.2"/><circle cx="280.5" cy="93.5" r="6.2"/><circle cx="280.5" cy="110.5" r="6.2"/><circle cx="280.5" cy="127.5" r="6.2"/><circle cx="280.5" cy="144.5" r="6.2"/><circle cx="280.5" cy="161.5" r="6.2"/><circle cx="280.5" cy="178.5" r="6.2"/><circle cx="280.5" cy="195.5" r="6.2"/><circle cx="280.5" cy="212.5" r="6.2"/><circle cx="280.5" cy="229.5" r="6.2"/><circle cx="280.5" cy="246.5" r="6.2"/><circle cx="280.5" cy="263.5" r="6.2"/><circle cx="280.5" cy="280.5" r="6.2"/><circle cx="280.5" cy="297.5" r="6.2"/><circle cx="280.5" cy="314.5" r="6.2"/><circle cx="280.5" cy="331.5" r="6.2"/><circle cx="280.5" cy="348.5" r="6.2"/><circle cx="297.5" cy="8.5" r="6.2"/><circle cx="297.5" cy="25.5" r="6.2"/><circle cx="297.5" cy="42.5" r="6.2"/><circle cx="297.5" cy="59.5" r="6.2"/><circle cx="297.5" cy="76.5" r="6.2"/><circle cx="297.5" cy="93.5" r="6.2"/><circle cx="297.5" cy="110.5" r="6.2"/><circle cx="297.5" cy="127.5" r="6.2"/><circle cx="297.5" cy="144.5" r="6.2"/><circle cx="297.5" cy="161.5" r="6.2"/><circle cx="297.5" cy="178.5" r="6.2"/><circle cx="297.5" cy="195.5" r="6.2"/><circle cx="297.5" cy="212.5" r="6.2"/><circle cx="297.5" cy="229.5" r="6.2"/><circle cx="297.5" cy="246.5" r="6.2"/><circle cx="297.5" cy="263.5" r="6.2"/><circle cx="297.5" cy="280.5" r="6.2"/><circle cx="297.5" cy="297.5" r="6.2"/><circle cx="297.5" cy="314.5" r="6.2"/><circle cx="297.5" cy="331.5" r="6.2"/><circle cx="297.5" cy="348.5" r="6.2"/><circle cx="314.5" cy="8.5" r="6.2"/><circle cx="314.5" cy="25.5" r="6.2"/><circle cx="314.5" cy="42.5" r="6.2"/><circle cx="314.5" cy="59.5" r="6.2"/><circle cx="314.5" cy="76.5" r="6.2"/><circle cx="314.5" cy="93.5" r="6.2"/><circle cx="314.5" cy="110.5" r="6.2"/><circle cx="314.5" cy="127.5" r="6.2"/><circle cx="314.5" cy="144.5" r="6.2"/><circle cx="314.5" cy="161.5" r="6.2"/><circle cx="314.5" cy="178.5" r="6.2"/><circle cx="314.5" cy="195.5" r="6.2"/><circle cx="314.5" cy="212.5" r="6.2"/><circle cx="314.5" cy="229.5" r="6.2"/><circle cx="314.5" cy="246.5" r="6.2"/><circle cx="314.5" cy="263.5" r="6.2"/><circle cx="314.5" cy="280.5" r="6.2"/><circle cx="314.5" cy="297.5" r="6.2"/><circle cx="314.5" cy="314.5" r="6.2"/><circle cx="314.5" cy="331.5" r="6.2"/><circle cx="314.5" cy="348.5" r="6.2"/><circle cx="331.5" cy="8.5" r="6.2"/><circle cx="331.5" cy="25.5" r="6.2"/><circle cx="331.5" cy="42.5" r="6.2"/><circle cx="331.5" cy="59.5" r="6.2"/><circle cx="331.5" cy="76.5" r="6.2"/><circle cx="331.5" cy="93.5" r="6.2"/><circle cx="331.5" cy="110.5" r="6.2"/><circle cx="331.5" cy="127.5" r="6.2"/><circle cx="331.5" cy="144.5" r="6.2"/><circle cx="331.5" cy="161.5" r="6.2"/><circle cx="331.5" cy="178.5" r="6.2"/><circle cx="331.5" cy="195.5" r="6.2"/><circle cx="331.5" cy="212.5" r="6.2"/><circle cx="331.5" cy="229.5" r="6.2"/><circle cx="331.5" cy="246.5" r="6.2"/><circle cx="331.5" cy="263.5" r="6.2"/><circle cx="331.5" cy="280.5" r="6.2"/><circle cx="331.5" cy="297.5" r="6.2"/><circle cx="331.5" cy="314.5" r="6.2"/><circle cx="331.5" cy="331.5" r="6.2"/><circle cx="331.5" cy="348.5" r="6.2"/><circle cx="348.5" cy="8.5" r="6.2"/><circle cx="348.5" cy="25.5" r="6.2"/><circle cx="348.5" cy="42.5" r="6.2"/><circle cx="348.5" cy="59.5" r="6.2"/><circle cx="348.5" cy="76.5" r="6.2"/><circle cx="348.5" cy="93.5" r="6.2"/><circle cx="348.5" cy="110.5" r="6.2"/><circle cx="348.5" cy="127.5" r="6.2"/><circle cx="348.5" cy="144.5" r="6.2"/><circle cx="348.5" cy="161.5" r="6.2"/><circle cx="348.5" cy="178.5" r="6.2"/><circle cx="348.5" cy="195.5" r="6.2"/><circle cx="348.5" cy="212.5" r="6.2"/><circle cx="348.5" cy="229.5" r="6.2"/><circle cx="348.5" cy="246.5" r="6.2"/><circle cx="348.5" cy="263.5" r="6.2"/><circle cx="348.5" cy="280.5" r="6.2"/><circle cx="348.5" cy="297.5" r="6.2"/><circle cx="348.5" cy="314.5" r="6.2"/><circle cx="348.5" cy="331.5" r="6.2"/><circle cx="348.5" cy="348.5" r="6.2"/><circle cx="365.5" cy="8.5" r="6.2"/><circle cx="365.5" cy="25.5" r="6.2"/><circle cx="365.5" cy="42.5" r="6.2"/><circle cx="365.5" cy="59.5" r="6.2"/><circle cx="365.5" cy="76.5" r="6.2"/><circle cx="365.5" cy="93.5" r="6.2"/><circle cx="365.5" cy="110.5" r="6.2"/><circle cx="365.5" cy="127.5" r="6.2"/><circle cx="365.5" cy="144.5" r="6.2"/><circle cx="365.5" cy="161.5" r="6.2"/><circle cx="365.5" cy="178.5" r="6.2"/><circle cx="365.5" cy="195.5" r="6.2"/><circle cx="365.5" cy="212.5" r="6.2"/><circle cx="365.5" cy="229.5" r="6.2"/><circle cx="365.5" cy="246.5" r="6.2"/><circle cx="365.5" cy="263.5" r="6.2"/><circle cx="365.5" cy="280.5" r="6.2"/><circle cx="365.5" cy="297.5" r="6.2"/><circle cx="365.5" cy="314.5" r="6.2"/><circle cx="365.5" cy="331.5" r="6.2"/><circle cx="365.5" cy="348.5" r="6.2"/><circle cx="382.5" cy="8.5" r="6.2"/><circle cx="382.5" cy="25.5" r="6.2"/><circle cx="382.5" cy="42.5" r="6.2"/><circle cx="382.5" cy="59.5" r="6.2"/><circle cx="382.5" cy="76.5" r="6.2"/><circle cx="382.5" cy="93.5" r="6.2"/><circle cx="382.5" cy="110.5" r="6.2"/><circle cx="382.5" cy="127.5" r="6.2"/><circle cx="382.5" cy="144.5" r="6.2"/><circle cx="382.5" cy="161.5" r="6.2"/><circle cx="382.5" cy="178.5" r="6.2"/><circle cx="382.5" cy="195.5" r="6.2"/><circle cx="382.5" cy="212.5" r="6.2"/><circle cx="382.5" cy="229.5" r="6.2"/><circle cx="382.5" cy="246.5" r="6.2"/><circle cx="382.5" cy="263.5" r="6.2"/><circle cx="382.5" cy="280.5" r="6.2"/><circle cx="382.5" cy="297.5" r="6.2"/><circle cx="382.5" cy="314.5" r="6.2"/><circle cx="382.5" cy="331.5" r="6.2"/><circle cx="382.5" cy="348.5" r="6.2"/><circle cx="399.5" cy="8.5" r="6.2"/><circle cx="399.5" cy="25.5" r="6.2"/><circle cx="399.5" cy="42.5" r="6.2"/><circle cx="399.5" cy="59.5" r="6.2"/><circle cx="399.5" cy="76.5" r="6.2"/><circle cx="399.5" cy="93.5" r="6.2"/><circle cx="399.5" cy="110.5" r="6.2"/><circle cx="399.5" cy="127.5" r="6.2"/><circle cx="399.5" cy="144.5" r="6.2"/><circle cx="399.5" cy="161.5" r="6.2"/><circle cx="399.5" cy="178.5" r="6.2"/><circle cx="399.5" cy="195.5" r="6.2"/><circle cx="399.5" cy="212.5" r="6.2"/><circle cx="399.5" cy="229.5" r="6.2"/><circle cx="399.5" cy="246.5" r="6.2"/><circle cx="399.5" cy="263.5" r="6.2"/><circle cx="399.5" cy="280.5" r="6.2"/><circle cx="399.5" cy="297.5" r="6.2"/><circle cx="399.5" cy="314.5" r="6.2"/><circle cx="399.5" cy="331.5" r="6.2"/><circle cx="399.5" cy="348.5" r="6.2"/><circle cx="416.5" cy="8.5" r="6.2"/><circle cx="416.5" cy="25.5" r="6.2"/><circle cx="416.5" cy="42.5" r="6.2"/><circle cx="416.5" cy="59.5" r="6.2"/><circle cx="416.5" cy="76.5" r="6.2"/><circle cx="416.5" cy="93.5" r="6.2"/><circle cx="416.5" cy="110.5" r="6.2"/><circle cx="416.5" cy="127.5" r="6.2"/><circle cx="416.5" cy="144.5" r="6.2"/><circle cx="416.5" cy="161.5" r="6.2"/><circle cx="416.5" cy="178.5" r="6.2"/><circle cx="416.5" cy="195.5" r="6.2"/><circle cx="416.5" cy="212.5" r="6.2"/><circle cx="416.5" cy="229.5" r="6.2"/><circle cx="416.5" cy="246.5" r="6.2"/><circle cx="416.5" cy="263.5" r="6.2"/><circle cx="416.5" cy="280.5" r="6.2"/><circle cx="416.5" cy="297.5" r="6.2"/><circle cx="416.5" cy="314.5" r="6.2"/><circle cx="416.5" cy="331.5" r="6.2"/><circle cx="416.5" cy="348.5" r="6.2"/><circle cx="433.5" cy="8.5" r="6.2"/><circle cx="433.5" cy="25.5" r="6.2"/><circle cx="433.5" cy="42.5" r="6.2"/><circle cx="433.5" cy="59.5" r="6.2"/><circle cx="433.5" cy="76.5" r="6.2"/><circle cx="433.5" cy="93.5" r="6.2"/><circle cx="433.5" cy="110.5" r="6.2"/><circle cx="433.5" cy="127.5" r="6.2"/><circle cx="433.5" cy="144.5" r="6.2"/><circle cx="433.5" cy="161.5" r="6.2"/><circle cx="433.5" cy="178.5" r="6.2"/><circle cx="433.5" cy="195.5" r="6.2"/><circle cx="433.5" cy="212.5" r="6.2"/><circle cx="433.5" cy="229.5" r="6.2"/><circle cx="433.5" cy="246.5" r="6.2"/><circle cx="433.5" cy="263.5" r="6.2"/><circle cx="433.5" cy="280.5" r="6.2"/><circle cx="433.5" cy="297.5" r="6.2"/><circle cx="433.5" cy="314.5" r="6.2"/><circle cx="433.5" cy="331.5" r="6.2"/><circle cx="433.5" cy="348.5" r="6.2"/><circle cx="450.5" cy="8.5" r="6.2"/><circle cx="450.5" cy="25.5" r="6.2"/><circle cx="450.5" cy="42.5" r="6.2"/><circle cx="450.5" cy="59.5" r="6.2"/><circle cx="450.5" cy="76.5" r="6.2"/><circle cx="450.5" cy="93.5" r="6.2"/><circle cx="450.5" cy="110.5" r="6.2"/><circle cx="450.5" cy="127.5" r="6.2"/><circle cx="450.5" cy="144.5" r="6.2"/><circle cx="450.5" cy="161.5" r="6.2"/><circle cx="450.5" cy="178.5" r="6.2"/><circle cx="450.5" cy="195.5" r="6.2"/><circle cx="450.5" cy="212.5" r="6.2"/><circle cx="450.5" cy="229.5" r="6.2"/><circle cx="450.5" cy="246.5" r="6.2"/><circle cx="450.5" cy="263.5" r="6.2"/><circle cx="450.5" cy="280.5" r="6.2"/><circle cx="450.5" cy="297.5" r="6.2"/><circle cx="450.5" cy="314.5" r="6.2"/><circle cx="450.5" cy="331.5" r="6.2"/><circle cx="450.5" cy="348.5" r="6.2"/><circle cx="467.5" cy="8.5" r="6.2"/><circle cx="467.5" cy="25.5" r="6.2"/><circle cx="467.5" cy="42.5" r="6.2"/><circle cx="467.5" cy="59.5" r="6.2"/><circle cx="467.5" cy="76.5" r="6.2"/><circle cx="467.5" cy="93.5" r="6.2"/><circle cx="467.5" cy="110.5" r="6.2"/><circle cx="467.5" cy="127.5" r="6.2"/><circle cx="467.5" cy="144.5" r="6.2"/><circle cx="467.5" cy="161.5" r="6.2"/><circle cx="467.5" cy="178.5" r="6.2"/><circle cx="467.5" cy="195.5" r="6.2"/><circle cx="467.5" cy="212.5" r="6.2"/><circle cx="467.5" cy="229.5" r="6.2"/><circle cx="467.5" cy="246.5" r="6.2"/><circle cx="467.5" cy="263.5" r="6.2"/><circle cx="467.5" cy="280.5" r="6.2"/><circle cx="467.5" cy="297.5" r="6.2"/><circle cx="467.5" cy="314.5" r="6.2"/><circle cx="467.5" cy="331.5" r="6.2"/><circle cx="467.5" cy="348.5" r="6.2"/><circle cx="484.5" cy="8.5" r="6.2"/><circle cx="484.5" cy="25.5" r="6.2"/><circle cx="484.5" cy="42.5" r="6.2"/><circle cx="484.5" cy="59.5" r="6.2"/><circle cx="484.5" cy="76.5" r="6.2"/><circle cx="484.5" cy="93.5" r="6.2"/><circle cx="484.5" cy="110.5" r="6.2"/><circle cx="484.5" cy="127.5" r="6.2"/><circle cx="484.5" cy="144.5" r="6.2"/><circle cx="484.5" cy="161.5" r="6.2"/><circle cx="484.5" cy="178.5" r="6.2"/><circle cx="484.5" cy="195.5" r="6.2"/><circle cx="484.5" cy="212.5" r="6.2"/><circle cx="484.5" cy="229.5" r="6.2"/><circle cx="484.5" cy="246.5" r="6.2"/><circle cx="484.5" cy="263.5" r="6.2"/><circle cx="484.5" cy="280.5" r="6.2"/><circle cx="484.5" cy="297.5" r="6.2"/><circle cx="484.5" cy="314.5" r="6.2"/><circle cx="484.5" cy="331.5" r="6.2"/><circle cx="484.5" cy="348.5" r="6.2"/><circle cx="501.5" cy="8.5" r="6.2"/><circle cx="501.5" cy="25.5" r="6.2"/><circle cx="501.5" cy="42.5" r="6.2"/><circle cx="501.5" cy="59.5" r="6.2"/><circle cx="501.5" cy="76.5" r="6.2"/><circle cx="501.5" cy="93.5" r="6.2"/><circle cx="501.5" cy="110.5" r="6.2"/><circle cx="501.5" cy="127.5" r="6.2"/><circle cx="501.5" cy="144.5" r="6.2"/><circle cx="501.5" cy="161.5" r="6.2"/><circle cx="501.5" cy="178.5" r="6.2"/><circle cx="501.5" cy="195.5" r="6.2"/><circle cx="501.5" cy="212.5" r="6.2"/><circle cx="501.5" cy="229.5" r="6.2"/><circle cx="501.5" cy="246.5" r="6.2"/><circle cx="501.5" cy="263.5" r="6.2"/><circle cx="501.5" cy="280.5" r="6.2"/><circle cx="501.5" cy="297.5" r="6.2"/><circle cx="501.5" cy="314.5" r="6.2"/><circle cx="501.5" cy="331.5" r="6.2"/><circle cx="501.5" cy="348.5" r="6.2"/><circle cx="518.5" cy="8.5" r="6.2"/><circle cx="518.5" cy="25.5" r="6.2"/><circle cx="518.5" cy="42.5" r="6.2"/><circle cx="518.5" cy="59.5" r="6.2"/><circle cx="518.5" cy="76.5" r="6.2"/><circle cx="518.5" cy="93.5" r="6.2"/><circle cx="518.5" cy="110.5" r="6.2"/><circle cx="518.5" cy="127.5" r="6.2"/><circle cx="518.5" cy="144.5" r="6.2"/><circle cx="518.5" cy="161.5" r="6.2"/><circle cx="518.5" cy="178.5" r="6.2"/><circle cx="518.5" cy="195.5" r="6.2"/><circle cx="518.5" cy="212.5" r="6.2"/><circle cx="518.5" cy="229.5" r="6.2"/><circle cx="518.5" cy="246.5" r="6.2"/><circle cx="518.5" cy="263.5" r="6.2"/><circle cx="518.5" cy="280.5" r="6.2"/><circle cx="518.5" cy="297.5" r="6.2"/><circle cx="518.5" cy="314.5" r="6.2"/><circle cx="518.5" cy="331.5" r="6.2"/><circle cx="518.5" cy="348.5" r="6.2"/><circle cx="535.5" cy="8.5" r="6.2"/><circle cx="535.5" cy="25.5" r="6.2"/><circle cx="535.5" cy="42.5" r="6.2"/><circle cx="535.5" cy="59.5" r="6.2"/><circle cx="535.5" cy="76.5" r="6.2"/><circle cx="535.5" cy="93.5" r="6.2"/><circle cx="535.5" cy="110.5" r="6.2"/><circle cx="535.5" cy="127.5" r="6.2"/><circle cx="535.5" cy="144.5" r="6.2"/><circle cx="535.5" cy="161.5" r="6.2"/><circle cx="535.5" cy="178.5" r="6.2"/><circle cx="535.5" cy="195.5" r="6.2"/><circle cx="535.5" cy="212.5" r="6.2"/><circle cx="535.5" cy="229.5" r="6.2"/><circle cx="535.5" cy="246.5" r="6.2"/><circle cx="535.5" cy="263.5" r="6.2"/><circle cx="535.5" cy="280.5" r="6.2"/><circle cx="535.5" cy="297.5" r="6.2"/><circle cx="535.5" cy="314.5" r="6.2"/><circle cx="535.5" cy="331.5" r="6.2"/><circle cx="535.5" cy="348.5" r="6.2"/><circle cx="552.5" cy="8.5" r="6.2"/><circle cx="552.5" cy="25.5" r="6.2"/><circle cx="552.5" cy="42.5" r="6.2"/><circle cx="552.5" cy="59.5" r="6.2"/><circle cx="552.5" cy="76.5" r="6.2"/><circle cx="552.5" cy="93.5" r="6.2"/><circle cx="552.5" cy="110.5" r="6.2"/><circle cx="552.5" cy="127.5" r="6.2"/><circle cx="552.5" cy="144.5" r="6.2"/><circle cx="552.5" cy="161.5" r="6.2"/><circle cx="552.5" cy="178.5" r="6.2"/><circle cx="552.5" cy="195.5" r="6.2"/><circle cx="552.5" cy="212.5" r="6.2"/><circle cx="552.5" cy="229.5" r="6.2"/><circle cx="552.5" cy="246.5" r="6.2"/><circle cx="552.5" cy="263.5" r="6.2"/><circle cx="552.5" cy="280.5" r="6.2"/><circle cx="552.5" cy="297.5" r="6.2"/><circle cx="552.5" cy="314.5" r="6.2"/><circle cx="552.5" cy="331.5" r="6.2"/><circle cx="552.5" cy="348.5" r="6.2"/><circle cx="569.5" cy="8.5" r="6.2"/><circle cx="569.5" cy="25.5" r="6.2"/><circle cx="569.5" cy="42.5" r="6.2"/><circle cx="569.5" cy="59.5" r="6.2"/><circle cx="569.5" cy="76.5" r="6.2"/><circle cx="569.5" cy="93.5" r="6.2"/><circle cx="569.5" cy="110.5" r="6.2"/><circle cx="569.5" cy="127.5" r="6.2"/><circle cx="569.5" cy="144.5" r="6.2"/><circle cx="569.5" cy="161.5" r="6.2"/><circle cx="569.5" cy="178.5" r="6.2"/><circle cx="569.5" cy="195.5" r="6.2"/><circle cx="569.5" cy="212.5" r="6.2"/><circle cx="569.5" cy="229.5" r="6.2"/><circle cx="569.5" cy="246.5" r="6.2"/><circle cx="569.5" cy="263.5" r="6.2"/><circle cx="569.5" cy="280.5" r="6.2"/><circle cx="569.5" cy="297.5" r="6.2"/><circle cx="569.5" cy="314.5" r="6.2"/><circle cx="569.5" cy="331.5" r="6.2"/><circle cx="569.5" cy="348.5" r="6.2"/><circle cx="586.5" cy="8.5" r="6.2"/><circle cx="586.5" cy="25.5" r="6.2"/><circle cx="586.5" cy="42.5" r="6.2"/><circle cx="586.5" cy="59.5" r="6.2"/><circle cx="586.5" cy="76.5" r="6.2"/><circle cx="586.5" cy="93.5" r="6.2"/><circle cx="586.5" cy="110.5" r="6.2"/><circle cx="586.5" cy="127.5" r="6.2"/><circle cx="586.5" cy="144.5" r="6.2"/><circle cx="586.5" cy="161.5" r="6.2"/><circle cx="586.5" cy="178.5" r="6.2"/><circle cx="586.5" cy="195.5" r="6.2"/><circle cx="586.5" cy="212.5" r="6.2"/><circle cx="586.5" cy="229.5" r="6.2"/><circle cx="586.5" cy="246.5" r="6.2"/><circle cx="586.5" cy="263.5" r="6.2"/><circle cx="586.5" cy="280.5" r="6.2"/><circle cx="586.5" cy="297.5" r="6.2"/><circle cx="586.5" cy="314.5" r="6.2"/><circle cx="586.5" cy="331.5" r="6.2"/><circle cx="586.5" cy="348.5" r="6.2"/><circle cx="603.5" cy="8.5" r="6.2"/><circle cx="603.5" cy="25.5" r="6.2"/><circle cx="603.5" cy="42.5" r="6.2"/><circle cx="603.5" cy="59.5" r="6.2"/><circle cx="603.5" cy="76.5" r="6.2"/><circle cx="603.5" cy="93.5" r="6.2"/><circle cx="603.5" cy="110.5" r="6.2"/><circle cx="603.5" cy="127.5" r="6.2"/><circle cx="603.5" cy="144.5" r="6.2"/><circle cx="603.5" cy="161.5" r="6.2"/><circle cx="603.5" cy="178.5" r="6.2"/><circle cx="603.5" cy="195.5" r="6.2"/><circle cx="603.5" cy="212.5" r="6.2"/><circle cx="603.5" cy="229.5" r="6.2"/><circle cx="603.5" cy="246.5" r="6.2"/><circle cx="603.5" cy="263.5" r="6.2"/><circle cx="603.5" cy="280.5" r="6.2"/><circle cx="603.5" cy="297.5" r="6.2"/><circle cx="603.5" cy="314.5" r="6.2"/><circle cx="603.5" cy="331.5" r="6.2"/><circle cx="603.5" cy="348.5" r="6.2"/><circle cx="620.5" cy="8.5" r="6.2"/><circle cx="620.5" cy="25.5" r="6.2"/><circle cx="620.5" cy="42.5" r="6.2"/><circle cx="620.5" cy="59.5" r="6.2"/><circle cx="620.5" cy="76.5" r="6.2"/><circle cx="620.5" cy="93.5" r="6.2"/><circle cx="620.5" cy="110.5" r="6.2"/><circle cx="620.5" cy="127.5" r="6.2"/><circle cx="620.5" cy="144.5" r="6.2"/><circle cx="620.5" cy="161.5" r="6.2"/><circle cx="620.5" cy="178.5" r="6.2"/><circle cx="620.5" cy="195.5" r="6.2"/><circle cx="620.5" cy="212.5" r="6.2"/><circle cx="620.5" cy="229.5" r="6.2"/><circle cx="620.5" cy="246.5" r="6.2"/><circle cx="620.5" cy="263.5" r="6.2"/><circle cx="620.5" cy="280.5" r="6.2"/><circle cx="620.5" cy="297.5" r="6.2"/><circle cx="620.5" cy="314.5" r="6.2"/><circle cx="620.5" cy="331.5" r="6.2"/><circle cx="620.5" cy="348.5" r="6.2"/><circle cx="637.5" cy="8.5" r="6.2"/><circle cx="637.5" cy="25.5" r="6.2"/><circle cx="637.5" cy="42.5" r="6.2"/><circle cx="637.5" cy="59.5" r="6.2"/><circle cx="637.5" cy="76.5" r="6.2"/><circle cx="637.5" cy="93.5" r="6.2"/><circle cx="637.5" cy="110.5" r="6.2"/><circle cx="637.5" cy="127.5" r="6.2"/><circle cx="637.5" cy="144.5" r="6.2"/><circle cx="637.5" cy="161.5" r="6.2"/><circle cx="637.5" cy="178.5" r="6.2"/><circle cx="637.5" cy="195.5" r="6.2"/><circle cx="637.5" cy="212.5" r="6.2"/><circle cx="637.5" cy="229.5" r="6.2"/><circle cx="637.5" cy="246.5" r="6.2"/><circle cx="637.5" cy="263.5" r="6.2"/><circle cx="637.5" cy="280.5" r="6.2"/><circle cx="637.5" cy="297.5" r="6.2"/><circle cx="637.5" cy="314.5" r="6.2"/><circle cx="637.5" cy="331.5" r="6.2"/><circle cx="637.5" cy="348.5" r="6.2"/><circle cx="654.5" cy="8.5" r="6.2"/><circle cx="654.5" cy="25.5" r="6.2"/><circle cx="654.5" cy="42.5" r="6.2"/><circle cx="654.5" cy="59.5" r="6.2"/><circle cx="654.5" cy="76.5" r="6.2"/><circle cx="654.5" cy="93.5" r="6.2"/><circle cx="654.5" cy="110.5" r="6.2"/><circle cx="654.5" cy="127.5" r="6.2"/><circle cx="654.5" cy="144.5" r="6.2"/><circle cx="654.5" cy="161.5" r="6.2"/><circle cx="654.5" cy="178.5" r="6.2"/><circle cx="654.5" cy="195.5" r="6.2"/><circle cx="654.5" cy="212.5" r="6.2"/><circle cx="654.5" cy="229.5" r="6.2"/><circle cx="654.5" cy="246.5" r="6.2"/><circle cx="654.5" cy="263.5" r="6.2"/><circle cx="654.5" cy="280.5" r="6.2"/><circle cx="654.5" cy="297.5" r="6.2"/><circle cx="654.5" cy="314.5" r="6.2"/><circle cx="654.5" cy="331.5" r="6.2"/><circle cx="654.5" cy="348.5" r="6.2"/><circle cx="671.5" cy="8.5" r="6.2"/><circle cx="671.5" cy="25.5" r="6.2"/><circle cx="671.5" cy="42.5" r="6.2"/><circle cx="671.5" cy="59.5" r="6.2"/><circle cx="671.5" cy="76.5" r="6.2"/><circle cx="671.5" cy="93.5" r="6.2"/><circle cx="671.5" cy="110.5" r="6.2"/><circle cx="671.5" cy="127.5" r="6.2"/><circle cx="671.5" cy="144.5" r="6.2"/><circle cx="671.5" cy="161.5" r="6.2"/><circle cx="671.5" cy="178.5" r="6.2"/><circle cx="671.5" cy="195.5" r="6.2"/><circle cx="671.5" cy="212.5" r="6.2"/><circle cx="671.5" cy="229.5" r="6.2"/><circle cx="671.5" cy="246.5" r="6.2"/><circle cx="671.5" cy="263.5" r="6.2"/><circle cx="671.5" cy="280.5" r="6.2"/><circle cx="671.5" cy="297.5" r="6.2"/><circle cx="671.5" cy="314.5" r="6.2"/><circle cx="671.5" cy="331.5" r="6.2"/><circle cx="671.5" cy="348.5" r="6.2"/><circle cx="688.5" cy="8.5" r="6.2"/><circle cx="688.5" cy="25.5" r="6.2"/><circle cx="688.5" cy="42.5" r="6.2"/><circle cx="688.5" cy="59.5" r="6.2"/><circle cx="688.5" cy="76.5" r="6.2"/><circle cx="688.5" cy="93.5" r="6.2"/><circle cx="688.5" cy="110.5" r="6.2"/><circle cx="688.5" cy="127.5" r="6.2"/><circle cx="688.5" cy="144.5" r="6.2"/><circle cx="688.5" cy="161.5" r="6.2"/><circle cx="688.5" cy="178.5" r="6.2"/><circle cx="688.5" cy="195.5" r="6.2"/><circle cx="688.5" cy="212.5" r="6.2"/><circle cx="688.5" cy="229.5" r="6.2"/><circle cx="688.5" cy="246.5" r="6.2"/><circle cx="688.5" cy="263.5" r="6.2"/><circle cx="688.5" cy="280.5" r="6.2"/><circle cx="688.5" cy="297.5" r="6.2"/><circle cx="688.5" cy="314.5" r="6.2"/><circle cx="688.5" cy="331.5" r="6.2"/><circle cx="688.5" cy="348.5" r="6.2"/><circle cx="705.5" cy="8.5" r="6.2"/><circle cx="705.5" cy="25.5" r="6.2"/><circle cx="705.5" cy="42.5" r="6.2"/><circle cx="705.5" cy="59.5" r="6.2"/><circle cx="705.5" cy="76.5" r="6.2"/><circle cx="705.5" cy="93.5" r="6.2"/><circle cx="705.5" cy="110.5" r="6.2"/><circle cx="705.5" cy="127.5" r="6.2"/><circle cx="705.5" cy="144.5" r="6.2"/><circle cx="705.5" cy="161.5" r="6.2"/><circle cx="705.5" cy="178.5" r="6.2"/><circle cx="705.5" cy="195.5" r="6.2"/><circle cx="705.5" cy="212.5" r="6.2"/><circle cx="705.5" cy="229.5" r="6.2"/><circle cx="705.5" cy="246.5" r="6.2"/><circle cx="705.5" cy="263.5" r="6.2"/><circle cx="705.5" cy="280.5" r="6.2"/><circle cx="705.5" cy="297.5" r="6.2"/><circle cx="705.5" cy="314.5" r="6.2"/><circle cx="705.5" cy="331.5" r="6.2"/><circle cx="705.5" cy="348.5" r="6.2"/><circle cx="722.5" cy="8.5" r="6.2"/><circle cx="722.5" cy="25.5" r="6.2"/><circle cx="722.5" cy="42.5" r="6.2"/><circle cx="722.5" cy="59.5" r="6.2"/><circle cx="722.5" cy="76.5" r="6.2"/><circle cx="722.5" cy="93.5" r="6.2"/><circle cx="722.5" cy="110.5" r="6.2"/><circle cx="722.5" cy="127.5" r="6.2"/><circle cx="722.5" cy="144.5" r="6.2"/><circle cx="722.5" cy="161.5" r="6.2"/><circle cx="722.5" cy="178.5" r="6.2"/><circle cx="722.5" cy="195.5" r="6.2"/><circle cx="722.5" cy="212.5" r="6.2"/><circle cx="722.5" cy="229.5" r="6.2"/><circle cx="722.5" cy="246.5" r="6.2"/><circle cx="722.5" cy="263.5" r="6.2"/><circle cx="722.5" cy="280.5" r="6.2"/><circle cx="722.5" cy="297.5" r="6.2"/><circle cx="722.5" cy="314.5" r="6.2"/><circle cx="722.5" cy="331.5" r="6.2"/><circle cx="722.5" cy="348.5" r="6.2"/><circle cx="739.5" cy="8.5" r="6.2"/><circle cx="739.5" cy="25.5" r="6.2"/><circle cx="739.5" cy="42.5" r="6.2"/><circle cx="739.5" cy="59.5" r="6.2"/><circle cx="739.5" cy="76.5" r="6.2"/><circle cx="739.5" cy="93.5" r="6.2"/><circle cx="739.5" cy="110.5" r="6.2"/><circle cx="739.5" cy="127.5" r="6.2"/><circle cx="739.5" cy="144.5" r="6.2"/><circle cx="739.5" cy="161.5" r="6.2"/><circle cx="739.5" cy="178.5" r="6.2"/><circle cx="739.5" cy="195.5" r="6.2"/><circle cx="739.5" cy="212.5" r="6.2"/><circle cx="739.5" cy="229.5" r="6.2"/><circle cx="739.5" cy="246.5" r="6.2"/><circle cx="739.5" cy="263.5" r="6.2"/><circle cx="739.5" cy="280.5" r="6.2"/><circle cx="739.5" cy="297.5" r="6.2"/><circle cx="739.5" cy="314.5" r="6.2"/><circle cx="739.5" cy="331.5" r="6.2"/><circle cx="739.5" cy="348.5" r="6.2"/><circle cx="756.5" cy="8.5" r="6.2"/><circle cx="756.5" cy="25.5" r="6.2"/><circle cx="756.5" cy="42.5" r="6.2"/><circle cx="756.5" cy="59.5" r="6.2"/><circle cx="756.5" cy="76.5" r="6.2"/><circle cx="756.5" cy="93.5" r="6.2"/><circle cx="756.5" cy="110.5" r="6.2"/><circle cx="756.5" cy="127.5" r="6.2"/><circle cx="756.5" cy="144.5" r="6.2"/><circle cx="756.5" cy="161.5" r="6.2"/><circle cx="756.5" cy="178.5" r="6.2"/><circle cx="756.5" cy="195.5" r="6.2"/><circle cx="756.5" cy="212.5" r="6.2"/><circle cx="756.5" cy="229.5" r="6.2"/><circle cx="756.5" cy="246.5" r="6.2"/><circle cx="756.5" cy="263.5" r="6.2"/><circle cx="756.5" cy="280.5" r="6.2"/><circle cx="756.5" cy="297.5" r="6.2"/><circle cx="756.5" cy="314.5" r="6.2"/><circle cx="756.5" cy="331.5" r="6.2"/><circle cx="756.5" cy="348.5" r="6.2"/><circle cx="773.5" cy="8.5" r="6.2"/><circle cx="773.5" cy="25.5" r="6.2"/><circle cx="773.5" cy="42.5" r="6.2"/><circle cx="773.5" cy="59.5" r="6.2"/><circle cx="773.5" cy="76.5" r="6.2"/><circle cx="773.5" cy="93.5" r="6.2"/><circle cx="773.5" cy="110.5" r="6.2"/><circle cx="773.5" cy="127.5" r="6.2"/><circle cx="773.5" cy="144.5" r="6.2"/><circle cx="773.5" cy="161.5" r="6.2"/><circle cx="773.5" cy="178.5" r="6.2"/><circle cx="773.5" cy="195.5" r="6.2"/><circle cx="773.5" cy="212.5" r="6.2"/><circle cx="773.5" cy="229.5" r="6.2"/><circle cx="773.5" cy="246.5" r="6.2"/><circle cx="773.5" cy="263.5" r="6.2"/><circle cx="773.5" cy="280.5" r="6.2"/><circle cx="773.5" cy="297.5" r="6.2"/><circle cx="773.5" cy="314.5" r="6.2"/><circle cx="773.5" cy="331.5" r="6.2"/><circle cx="773.5" cy="348.5" r="6.2"/><circle cx="790.5" cy="8.5" r="6.2"/><circle cx="790.5" cy="25.5" r="6.2"/><circle cx="790.5" cy="42.5" r="6.2"/><circle cx="790.5" cy="59.5" r="6.2"/><circle cx="790.5" cy="76.5" r="6.2"/><circle cx="790.5" cy="93.5" r="6.2"/><circle cx="790.5" cy="110.5" r="6.2"/><circle cx="790.5" cy="127.5" r="6.2"/><circle cx="790.5" cy="144.5" r="6.2"/><circle cx="790.5" cy="161.5" r="6.2"/><circle cx="790.5" cy="178.5" r="6.2"/><circle cx="790.5" cy="195.5" r="6.2"/><circle cx="790.5" cy="212.5" r="6.2"/><circle cx="790.5" cy="229.5" r="6.2"/><circle cx="790.5" cy="246.5" r="6.2"/><circle cx="790.5" cy="263.5" r="6.2"/><circle cx="790.5" cy="280.5" r="6.2"/><circle cx="790.5" cy="297.5" r="6.2"/><circle cx="790.5" cy="314.5" r="6.2"/><circle cx="790.5" cy="331.5" r="6.2"/><circle cx="790.5" cy="348.5" r="6.2"/><circle cx="807.5" cy="8.5" r="6.2"/><circle cx="807.5" cy="25.5" r="6.2"/><circle cx="807.5" cy="42.5" r="6.2"/><circle cx="807.5" cy="59.5" r="6.2"/><circle cx="807.5" cy="76.5" r="6.2"/><circle cx="807.5" cy="93.5" r="6.2"/><circle cx="807.5" cy="110.5" r="6.2"/><circle cx="807.5" cy="127.5" r="6.2"/><circle cx="807.5" cy="144.5" r="6.2"/><circle cx="807.5" cy="161.5" r="6.2"/><circle cx="807.5" cy="178.5" r="6.2"/><circle cx="807.5" cy="195.5" r="6.2"/><circle cx="807.5" cy="212.5" r="6.2"/><circle cx="807.5" cy="229.5" r="6.2"/><circle cx="807.5" cy="246.5" r="6.2"/><circle cx="807.5" cy="263.5" r="6.2"/><circle cx="807.5" cy="280.5" r="6.2"/><circle cx="807.5" cy="297.5" r="6.2"/><circle cx="807.5" cy="314.5" r="6.2"/><circle cx="807.5" cy="331.5" r="6.2"/><circle cx="807.5" cy="348.5" r="6.2"/><circle cx="824.5" cy="8.5" r="6.2"/><circle cx="824.5" cy="25.5" r="6.2"/><circle cx="824.5" cy="42.5" r="6.2"/><circle cx="824.5" cy="59.5" r="6.2"/><circle cx="824.5" cy="76.5" r="6.2"/><circle cx="824.5" cy="93.5" r="6.2"/><circle cx="824.5" cy="110.5" r="6.2"/><circle cx="824.5" cy="127.5" r="6.2"/><circle cx="824.5" cy="144.5" r="6.2"/><circle cx="824.5" cy="161.5" r="6.2"/><circle cx="824.5" cy="178.5" r="6.2"/><circle cx="824.5" cy="195.5" r="6.2"/><circle cx="824.5" cy="212.5" r="6.2"/><circle cx="824.5" cy="229.5" r="6.2"/><circle cx="824.5" cy="246.5" r="6.2"/><circle cx="824.5" cy="263.5" r="6.2"/><circle cx="824.5" cy="280.5" r="6.2"/><circle cx="824.5" cy="297.5" r="6.2"/><circle cx="824.5" cy="314.5" r="6.2"/><circle cx="824.5" cy="331.5" r="6.2"/><circle cx="824.5" cy="348.5" r="6.2"/><circle cx="841.5" cy="8.5" r="6.2"/><circle cx="841.5" cy="25.5" r="6.2"/><circle cx="841.5" cy="42.5" r="6.2"/><circle cx="841.5" cy="59.5" r="6.2"/><circle cx="841.5" cy="76.5" r="6.2"/><circle cx="841.5" cy="93.5" r="6.2"/><circle cx="841.5" cy="110.5" r="6.2"/><circle cx="841.5" cy="127.5" r="6.2"/><circle cx="841.5" cy="144.5" r="6.2"/><circle cx="841.5" cy="161.5" r="6.2"/><circle cx="841.5" cy="178.5" r="6.2"/><circle cx="841.5" cy="195.5" r="6.2"/><circle cx="841.5" cy="212.5" r="6.2"/><circle cx="841.5" cy="229.5" r="6.2"/><circle cx="841.5" cy="246.5" r="6.2"/><circle cx="841.5" cy="263.5" r="6.2"/><circle cx="841.5" cy="280.5" r="6.2"/><circle cx="841.5" cy="297.5" r="6.2"/><circle cx="841.5" cy="314.5" r="6.2"/><circle cx="841.5" cy="331.5" r="6.2"/><circle cx="841.5" cy="348.5" r="6.2"/></g><g fill="var(--c4s-ok)" data-tip="136 clean complete recoveries"><circle cx="59.5" cy="229.5" r="6.2"/><circle cx="59.5" cy="246.5" r="6.2"/><circle cx="59.5" cy="263.5" r="6.2"/><circle cx="59.5" cy="280.5" r="6.2"/><circle cx="59.5" cy="297.5" r="6.2"/><circle cx="59.5" cy="314.5" r="6.2"/><circle cx="59.5" cy="331.5" r="6.2"/><circle cx="59.5" cy="348.5" r="6.2"/><circle cx="76.5" cy="8.5" r="6.2"/><circle cx="76.5" cy="25.5" r="6.2"/><circle cx="76.5" cy="42.5" r="6.2"/><circle cx="76.5" cy="59.5" r="6.2"/><circle cx="76.5" cy="76.5" r="6.2"/><circle cx="76.5" cy="93.5" r="6.2"/><circle cx="76.5" cy="110.5" r="6.2"/><circle cx="76.5" cy="127.5" r="6.2"/><circle cx="76.5" cy="144.5" r="6.2"/><circle cx="76.5" cy="161.5" r="6.2"/><circle cx="76.5" cy="178.5" r="6.2"/><circle cx="76.5" cy="195.5" r="6.2"/><circle cx="76.5" cy="212.5" r="6.2"/><circle cx="76.5" cy="229.5" r="6.2"/><circle cx="76.5" cy="246.5" r="6.2"/><circle cx="76.5" cy="263.5" r="6.2"/><circle cx="76.5" cy="280.5" r="6.2"/><circle cx="76.5" cy="297.5" r="6.2"/><circle cx="76.5" cy="314.5" r="6.2"/><circle cx="76.5" cy="331.5" r="6.2"/><circle cx="76.5" cy="348.5" r="6.2"/><circle cx="93.5" cy="8.5" r="6.2"/><circle cx="93.5" cy="25.5" r="6.2"/><circle cx="93.5" cy="42.5" r="6.2"/><circle cx="93.5" cy="59.5" r="6.2"/><circle cx="93.5" cy="76.5" r="6.2"/><circle cx="93.5" cy="93.5" r="6.2"/><circle cx="93.5" cy="110.5" r="6.2"/><circle cx="93.5" cy="127.5" r="6.2"/><circle cx="93.5" cy="144.5" r="6.2"/><circle cx="93.5" cy="161.5" r="6.2"/><circle cx="93.5" cy="178.5" r="6.2"/><circle cx="93.5" cy="195.5" r="6.2"/><circle cx="93.5" cy="212.5" r="6.2"/><circle cx="93.5" cy="229.5" r="6.2"/><circle cx="93.5" cy="246.5" r="6.2"/><circle cx="93.5" cy="263.5" r="6.2"/><circle cx="93.5" cy="280.5" r="6.2"/><circle cx="93.5" cy="297.5" r="6.2"/><circle cx="93.5" cy="314.5" r="6.2"/><circle cx="93.5" cy="331.5" r="6.2"/><circle cx="93.5" cy="348.5" r="6.2"/><circle cx="110.5" cy="8.5" r="6.2"/><circle cx="110.5" cy="25.5" r="6.2"/><circle cx="110.5" cy="42.5" r="6.2"/><circle cx="110.5" cy="59.5" r="6.2"/><circle cx="110.5" cy="76.5" r="6.2"/><circle cx="110.5" cy="93.5" r="6.2"/><circle cx="110.5" cy="110.5" r="6.2"/><circle cx="110.5" cy="127.5" r="6.2"/><circle cx="110.5" cy="144.5" r="6.2"/><circle cx="110.5" cy="161.5" r="6.2"/><circle cx="110.5" cy="178.5" r="6.2"/><circle cx="110.5" cy="195.5" r="6.2"/><circle cx="110.5" cy="212.5" r="6.2"/><circle cx="110.5" cy="229.5" r="6.2"/><circle cx="110.5" cy="246.5" r="6.2"/><circle cx="110.5" cy="263.5" r="6.2"/><circle cx="110.5" cy="280.5" r="6.2"/><circle cx="110.5" cy="297.5" r="6.2"/><circle cx="110.5" cy="314.5" r="6.2"/><circle cx="110.5" cy="331.5" r="6.2"/><circle cx="110.5" cy="348.5" r="6.2"/><circle cx="127.5" cy="8.5" r="6.2"/><circle cx="127.5" cy="25.5" r="6.2"/><circle cx="127.5" cy="42.5" r="6.2"/><circle cx="127.5" cy="59.5" r="6.2"/><circle cx="127.5" cy="76.5" r="6.2"/><circle cx="127.5" cy="93.5" r="6.2"/><circle cx="127.5" cy="110.5" r="6.2"/><circle cx="127.5" cy="127.5" r="6.2"/><circle cx="127.5" cy="144.5" r="6.2"/><circle cx="127.5" cy="161.5" r="6.2"/><circle cx="127.5" cy="178.5" r="6.2"/><circle cx="127.5" cy="195.5" r="6.2"/><circle cx="127.5" cy="212.5" r="6.2"/><circle cx="127.5" cy="229.5" r="6.2"/><circle cx="127.5" cy="246.5" r="6.2"/><circle cx="127.5" cy="263.5" r="6.2"/><circle cx="127.5" cy="280.5" r="6.2"/><circle cx="127.5" cy="297.5" r="6.2"/><circle cx="127.5" cy="314.5" r="6.2"/><circle cx="127.5" cy="331.5" r="6.2"/><circle cx="127.5" cy="348.5" r="6.2"/><circle cx="144.5" cy="8.5" r="6.2"/><circle cx="144.5" cy="25.5" r="6.2"/><circle cx="144.5" cy="42.5" r="6.2"/><circle cx="144.5" cy="59.5" r="6.2"/><circle cx="144.5" cy="76.5" r="6.2"/><circle cx="144.5" cy="93.5" r="6.2"/><circle cx="144.5" cy="110.5" r="6.2"/><circle cx="144.5" cy="127.5" r="6.2"/><circle cx="144.5" cy="144.5" r="6.2"/><circle cx="144.5" cy="161.5" r="6.2"/><circle cx="144.5" cy="178.5" r="6.2"/><circle cx="144.5" cy="195.5" r="6.2"/><circle cx="144.5" cy="212.5" r="6.2"/><circle cx="144.5" cy="229.5" r="6.2"/><circle cx="144.5" cy="246.5" r="6.2"/><circle cx="144.5" cy="263.5" r="6.2"/><circle cx="144.5" cy="280.5" r="6.2"/><circle cx="144.5" cy="297.5" r="6.2"/><circle cx="144.5" cy="314.5" r="6.2"/><circle cx="144.5" cy="331.5" r="6.2"/><circle cx="144.5" cy="348.5" r="6.2"/><circle cx="161.5" cy="8.5" r="6.2"/><circle cx="161.5" cy="25.5" r="6.2"/><circle cx="161.5" cy="42.5" r="6.2"/><circle cx="161.5" cy="59.5" r="6.2"/><circle cx="161.5" cy="76.5" r="6.2"/><circle cx="161.5" cy="93.5" r="6.2"/><circle cx="161.5" cy="110.5" r="6.2"/><circle cx="161.5" cy="127.5" r="6.2"/><circle cx="161.5" cy="144.5" r="6.2"/><circle cx="161.5" cy="161.5" r="6.2"/><circle cx="161.5" cy="178.5" r="6.2"/><circle cx="161.5" cy="195.5" r="6.2"/><circle cx="161.5" cy="212.5" r="6.2"/><circle cx="161.5" cy="229.5" r="6.2"/><circle cx="161.5" cy="246.5" r="6.2"/><circle cx="161.5" cy="263.5" r="6.2"/><circle cx="161.5" cy="280.5" r="6.2"/><circle cx="161.5" cy="297.5" r="6.2"/><circle cx="161.5" cy="314.5" r="6.2"/><circle cx="161.5" cy="331.5" r="6.2"/><circle cx="161.5" cy="348.5" r="6.2"/><circle cx="178.5" cy="8.5" r="6.2"/><circle cx="178.5" cy="25.5" r="6.2"/></g><g fill="var(--c4s-hot)" data-tip="76 complete recoveries that also changed something else"><circle cx="8.5" cy="8.5" r="6.2"/><circle cx="8.5" cy="25.5" r="6.2"/><circle cx="8.5" cy="42.5" r="6.2"/><circle cx="8.5" cy="59.5" r="6.2"/><circle cx="8.5" cy="76.5" r="6.2"/><circle cx="8.5" cy="93.5" r="6.2"/><circle cx="8.5" cy="110.5" r="6.2"/><circle cx="8.5" cy="127.5" r="6.2"/><circle cx="8.5" cy="144.5" r="6.2"/><circle cx="8.5" cy="161.5" r="6.2"/><circle cx="8.5" cy="178.5" r="6.2"/><circle cx="8.5" cy="195.5" r="6.2"/><circle cx="8.5" cy="212.5" r="6.2"/><circle cx="8.5" cy="229.5" r="6.2"/><circle cx="8.5" cy="246.5" r="6.2"/><circle cx="8.5" cy="263.5" r="6.2"/><circle cx="8.5" cy="280.5" r="6.2"/><circle cx="8.5" cy="297.5" r="6.2"/><circle cx="8.5" cy="314.5" r="6.2"/><circle cx="8.5" cy="331.5" r="6.2"/><circle cx="8.5" cy="348.5" r="6.2"/><circle cx="25.5" cy="8.5" r="6.2"/><circle cx="25.5" cy="25.5" r="6.2"/><circle cx="25.5" cy="42.5" r="6.2"/><circle cx="25.5" cy="59.5" r="6.2"/><circle cx="25.5" cy="76.5" r="6.2"/><circle cx="25.5" cy="93.5" r="6.2"/><circle cx="25.5" cy="110.5" r="6.2"/><circle cx="25.5" cy="127.5" r="6.2"/><circle cx="25.5" cy="144.5" r="6.2"/><circle cx="25.5" cy="161.5" r="6.2"/><circle cx="25.5" cy="178.5" r="6.2"/><circle cx="25.5" cy="195.5" r="6.2"/><circle cx="25.5" cy="212.5" r="6.2"/><circle cx="25.5" cy="229.5" r="6.2"/><circle cx="25.5" cy="246.5" r="6.2"/><circle cx="25.5" cy="263.5" r="6.2"/><circle cx="25.5" cy="280.5" r="6.2"/><circle cx="25.5" cy="297.5" r="6.2"/><circle cx="25.5" cy="314.5" r="6.2"/><circle cx="25.5" cy="331.5" r="6.2"/><circle cx="25.5" cy="348.5" r="6.2"/><circle cx="42.5" cy="8.5" r="6.2"/><circle cx="42.5" cy="25.5" r="6.2"/><circle cx="42.5" cy="42.5" r="6.2"/><circle cx="42.5" cy="59.5" r="6.2"/><circle cx="42.5" cy="76.5" r="6.2"/><circle cx="42.5" cy="93.5" r="6.2"/><circle cx="42.5" cy="110.5" r="6.2"/><circle cx="42.5" cy="127.5" r="6.2"/><circle cx="42.5" cy="144.5" r="6.2"/><circle cx="42.5" cy="161.5" r="6.2"/><circle cx="42.5" cy="178.5" r="6.2"/><circle cx="42.5" cy="195.5" r="6.2"/><circle cx="42.5" cy="212.5" r="6.2"/><circle cx="42.5" cy="229.5" r="6.2"/><circle cx="42.5" cy="246.5" r="6.2"/><circle cx="42.5" cy="263.5" r="6.2"/><circle cx="42.5" cy="280.5" r="6.2"/><circle cx="42.5" cy="297.5" r="6.2"/><circle cx="42.5" cy="314.5" r="6.2"/><circle cx="42.5" cy="331.5" r="6.2"/><circle cx="42.5" cy="348.5" r="6.2"/><circle cx="59.5" cy="8.5" r="6.2"/><circle cx="59.5" cy="25.5" r="6.2"/><circle cx="59.5" cy="42.5" r="6.2"/><circle cx="59.5" cy="59.5" r="6.2"/><circle cx="59.5" cy="76.5" r="6.2"/><circle cx="59.5" cy="93.5" r="6.2"/><circle cx="59.5" cy="110.5" r="6.2"/><circle cx="59.5" cy="127.5" r="6.2"/><circle cx="59.5" cy="144.5" r="6.2"/><circle cx="59.5" cy="161.5" r="6.2"/><circle cx="59.5" cy="178.5" r="6.2"/><circle cx="59.5" cy="195.5" r="6.2"/><circle cx="59.5" cy="212.5" r="6.2"/></g></svg><figcaption>One dot per Image-to-Scene evaluation (paper Figure 6c).</figcaption></figure></div></div></div></section><section id="cases"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Cases</span><h2 class="section-title">Turn the scenes yourself</h2> | |
| <p class="section-desc">For each selected case, every agent's saved scene is exported from Unreal Engine and opens in the browser in 3D, beside the evaluator's scores for it.</p></div> | |
| <div class="case-grid"><a class="case-card" href="cases.html#nordic-harbour"><div class="th" style="background-image:url('media/t2s/nordic-harbour/astra.jpg?v=1790542380')"><i>Text-to-Scene</i></div><div class="meta"><h4>Nordic Harbour</h4><p>14 agents scored · 11 scenes in 3D · best 0.877 (Astra)</p></div></a><a class="case-card" href="cases.html#medieval-big-farm-town"><div class="th" style="background-image:url('media/t2s/medieval-big-farm-town/fable.jpg?v=1790542357')"><i>Text-to-Scene</i></div><div class="meta"><h4>Medieval Big Farm Town</h4><p>14 agents scored · 6 scenes in 3D · best 0.830 (Fable)</p></div></a><a class="case-card" href="cases.html#egyptian-temple"><div class="th" style="background-image:url('media/t2s/egyptian-temple/opus.jpg?v=1790542327')"><i>Text-to-Scene</i></div><div class="meta"><h4>Egyptian Temple</h4><p>14 agents scored · 6 scenes in 3D · best 0.777 (Opus)</p></div></a><a class="case-card" href="cases.html#bazaar"><div class="th" style="background-image:url('media/t2s/bazaar/fable.jpg?v=1790542281')"><i>Text-to-Scene</i></div><div class="meta"><h4>Bazaar</h4><p>14 agents scored · 6 scenes in 3D · best 0.930 (Fable)</p></div></a><a class="case-card" href="cases.html#comp-31-old-industrial-pallet-bay-repair-v2"><div class="th" style="background-image:url('media/i2s/comp-31-old-industrial-pallet-bay-repair-v2/astra.jpg?v=1790731230')"><i>Image-to-Scene</i></div><div class="meta"><h4>Old Industrial Pallet Bay</h4><p>14 agents scored · 6 scenes in 3D · best 1.000 (Astra)</p></div></a><a class="case-card" href="cases.html#comp-61-new-york-mailbox-pair-repair-v2"><div class="th" style="background-image:url('media/i2s/comp-61-new-york-mailbox-pair-repair-v2/deepseek.jpg?v=1790550039')"><i>Image-to-Scene</i></div><div class="meta"><h4>New York Mailbox Pair</h4><p>14 agents scored · 6 scenes in 3D · best 1.000 (DeepSeek)</p></div></a></div> | |
| <div style="text-align:center;margin-top:2rem"><a class="btn btn-primary" href="cases.html"><svg viewBox="0 0 16 16" fill="none" stroke="currentColor" stroke-width="1.5" aria-hidden="true"><path d="M8 1.5l5.5 3v7L8 14.5l-5.5-3v-7z"/><path d="M2.5 4.5L8 7.5l5.5-3M8 7.5v7"/></svg> Open the case explorer</a></div> | |
| </div></section><section class="dark" id="citation"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Citation</span><h2 class="section-title">Cite This Work</h2></div> | |
| <div class="cite-box"><button class="cite-copy-btn" id="copy-btn">Copy</button><pre id="bibtex-text">@article{code4scene2026, | |
| title = {Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes}, | |
| author = {Ye, Xiaokang and Mantri, Siddhant Hitesh and Chen, Zimeng and Zhang, Edward and Zheng, Zhaoxu and Li, Yuanheng and Chen, Yizhao and Huang, Tianyang and Qin, Lianhui}, | |
| year = {2026} | |
| }</pre></div> | |
| <div style="display:flex;flex-wrap:wrap;gap:1rem;justify-content:center;margin-top:2rem"> | |
| <a class="btn btn-outline" href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener"><svg viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"/></svg> GitHub Repository</a> | |
| <a class="btn btn-outline" href="https://simworld.org/" target="_blank" rel="noopener">SimWorld Main Site</a></div> | |
| </div></section> | |
| <footer><p>Code4Scene · UC San Diego & UC Berkeley · <a href="https://github.com/SimWorld-AI/Code4Scene" target="_blank" rel="noopener">GitHub</a> · | |
| <a href="https://simworld.org/" target="_blank" rel="noopener">SimWorld Home</a></p> | |
| <p style="margin-top:.5rem;font-size:.75rem;color:rgba(255,255,255,.25)">Part of the SimWorld project.</p></footer> | |
| <script src="assets/paper.js?v=5427505a"></script> | |
| </body></html> |