TranSGrid / index.html
chenwen245299's picture
Upload 63 files
ab6cffe verified
Raw History Blame Contribute Delete
8.46 kB
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="theme-color" content="#ffffff">
<title>TranSGrid | Interactive Demo</title>
<link rel="stylesheet" href="style.css">
<script src="app.js" defer></script>
</head>
<body>
<main class="page">
<header class="page-header">
<h1>What Do Current Systematic Generalization Tasks Miss?<br>A Reasoning-Centered Analysis</h1>
<nav class="resource-links" aria-label="Project resources">
<a href="https://arxiv.org/abs/2609.19212"><img src="https://img.shields.io/badge/arXiv-2609.19212-b31b1b?logo=arxiv" alt="arXiv paper"></a>
<a href="https://github.com/BlueWhaleLab/TranSGrid"><img src="https://img.shields.io/badge/Code-GitHub-181717?logo=github" alt="GitHub code"></a>
<a href="https://huggingface.co/datasets/BlueWhaleLab/TranSGrid"><img src="https://img.shields.io/badge/Hugging%20Face-Dataset-FFD21E?logo=huggingface" alt="Hugging Face dataset"></a>
<a href="https://huggingface.co/BlueWhaleLab/TranSGrid"><img src="https://img.shields.io/badge/Hugging%20Face-Models-FFD21E?logo=huggingface" alt="Hugging Face models"></a>
</nav>
<p>TranSGrid is a grid-transformation task for studying systematic generalization. Given an initial and a target board, a model predicts a sequence of row, column, and 2 × 2 block operations that transforms one into the other. Browse the ten atomic actions below, then explore examples and replay the selected model's prediction step by step <strong>(Note: This demo shows precomputed evaluation results; it does not run models live)</strong>.</p>
</header>
<section class="demo" aria-label="TranSGrid demo">
<div class="tabs" role="tablist" aria-label="Demo sections">
<button type="button" id="tab-atomic-actions" class="tab" role="tab" aria-selected="true" aria-controls="panel-atomic-actions" data-hash="atomic-actions"><span class="tab-icon" aria-hidden="true">⚛️</span>Atomic actions</button>
<button type="button" id="tab-interactive-demo" class="tab" role="tab" aria-selected="false" aria-controls="panel-interactive-demo" tabindex="-1" data-hash="interactive-demo"><span class="tab-icon" aria-hidden="true">🎮</span>Interactive demo</button>
</div>
<div id="panel-atomic-actions" class="tabpanel" role="tabpanel" aria-labelledby="tab-atomic-actions">
<h2 class="visually-hidden">Atomic actions</h2>
<div class="atomic-intro">
<p>Every solution is a sequence of atomic actions. There are ten of them: four act on rows and four on columns (each either shifts one row or column by a cell, or swaps it with its neighbour), and two rotate a 2 × 2 block. Each card below applies one action, with example arguments, to the same 6 × 6 board. Rows and columns wrap around the edges of the board; a block must fit entirely inside it. Press <strong>Play</strong> to watch an action move the cells.</p>
<ul class="legend" aria-label="Board colour key">
<li><span class="swatch swatch-move" aria-hidden="true"></span>Cells the action moves; arrows show where each one goes</li>
<li><span class="swatch swatch-change" aria-hidden="true"></span>Cells whose digit changed</li>
</ul>
</div>
<div id="atomic-groups" class="atomic-groups"></div>
</div>
<div id="panel-interactive-demo" class="tabpanel" role="tabpanel" aria-labelledby="tab-interactive-demo" hidden>
<h2 class="visually-hidden">Interactive demo</h2>
<div class="controls" aria-label="Demo controls">
<div class="field"><label for="dataset">Dataset</label>
<select id="dataset">
<option value="Test">Test</option>
<option value="TranSGrid">TranSGrid</option>
<option value="Decoupled">TranSGrid (Decoupled)</option>
<option value="SCAN">TranSGrid (SCAN)</option>
</select>
</div>
<div class="field"><label for="level">Model size</label>
<select id="level">
<option value="1">Level 1</option>
<option value="2">Level 2</option>
<option value="3" selected>Level 3</option>
<option value="4">Level 4</option>
<option value="5">Level 5</option>
<option value="6">Level 6</option>
<option value="7">Level 7</option>
</select>
</div>
<div class="field"><label for="decoding">Decoding</label>
<select id="decoding">
<option value="greedy">Greedy</option>
<option value="beam8">Top@8</option>
</select>
</div>
<div class="field"><label for="length">Reference length</label>
<select id="length">
<option value="all">All lengths</option>
<option value="1">1</option><option value="2">2</option>
<option value="3">3</option><option value="4">4</option>
<option value="5">5</option><option value="6">6</option>
<option value="7">7</option><option value="8">8</option>
<option value="9">9</option><option value="10">10</option>
<option value="11">11</option><option value="12">12</option>
</select>
</div>
<div class="field"><label for="outcome">Outcome</label>
<select id="outcome">
<option value="all">All outcomes</option>
<option value="solved">Solved</option>
<option value="unsolved">Not solved</option>
</select>
</div>
<button id="random" class="primary">Random question</button>
</div>
<p id="summary" class="summary" role="status"></p>
<div id="message" class="message" role="status" aria-live="polite">Loading an example…</div>
<div class="prediction-summary">
<div class="question-line">
<span id="result-badge" class="result-badge" hidden></span>
<div class="question-meta">Question <span id="question-id">—</span> · Reference length <span id="question-length">—</span></div>
<form id="goto-form" class="goto">
<label for="goto-id">Go to question</label>
<input id="goto-id" type="text" inputmode="numeric" autocomplete="off" placeholder="ID">
<button type="submit">Go</button>
</form>
</div>
<div id="given-group" class="prediction-sequence" hidden>
<h3>Given to the model</h3>
<p id="given-note" class="action-note"></p>
<ol id="given-actions" class="actions" aria-label="Actions given to the model"></ol>
</div>
<div class="prediction-sequence">
<h3>Model prediction</h3>
<p id="prediction-note" class="action-note"></p>
<ol id="actions" class="actions" aria-label="Model prediction actions"></ol>
</div>
</div>
<div class="demo-head">
<div>
<h3 id="step-label">Select an example</h3>
<p id="step-description">The current board will replay the selected prediction.</p>
</div>
<div class="playback-panel">
<div class="player">
<button id="play" disabled>▶ Play</button>
<button id="pause" disabled>Pause</button>
<button id="next" disabled>Next action</button>
<button id="reset" disabled>Reset</button>
</div>
<div class="playback-meta">
<span id="progress">0 / 0 actions</span>
</div>
</div>
</div>
<div class="boards">
<figure><figcaption>Initial</figcaption><canvas id="initial-board" aria-label="Initial board"></canvas></figure>
<figure><figcaption>Current</figcaption><canvas id="current-board" aria-label="Current board"></canvas></figure>
<figure><figcaption>Target</figcaption><canvas id="target-board" aria-label="Target board"></canvas></figure>
</div>
</div>
</section>
<footer id="demo-footer" hidden>
<span id="file-note"></span>
<span id="beam-note" hidden>Top@8 displays the one selected prediction saved in the result file.</span>
</footer>
</main>
</body>
</html>