Spaces:
Running
Running
Upload index.html with huggingface_hub
Browse files- index.html +133 -18
index.html
CHANGED
|
@@ -1,19 +1,134 @@
|
|
| 1 |
-
<!
|
| 2 |
-
<html>
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
</html>
|
|
|
|
| 1 |
+
<!DOCTYPE html>
|
| 2 |
+
<html lang="en">
|
| 3 |
+
<head>
|
| 4 |
+
<meta charset="UTF-8">
|
| 5 |
+
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
| 6 |
+
<title>Minecraft Agent — Qwen3.5-9B</title>
|
| 7 |
+
<style>
|
| 8 |
+
:root {
|
| 9 |
+
--bg: #0d1117; --card: #161b22; --border: #30363d;
|
| 10 |
+
--text: #e6edf3; --muted: #8b949e; --green: #3fb950; --blue: #58a6ff; --gold: #d29922;
|
| 11 |
+
}
|
| 12 |
+
* { margin: 0; padding: 0; box-sizing: border-box; }
|
| 13 |
+
body { background: var(--bg); color: var(--text); font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif; line-height: 1.6; }
|
| 14 |
+
.container { max-width: 1080px; margin: 0 auto; padding: 0 24px 80px; }
|
| 15 |
+
header { text-align: center; padding: 64px 0 40px; }
|
| 16 |
+
header .emoji { font-size: 56px; }
|
| 17 |
+
h1 { font-size: 36px; margin: 12px 0 8px; }
|
| 18 |
+
header p { color: var(--muted); font-size: 17px; max-width: 640px; margin: 0 auto; }
|
| 19 |
+
.badges { margin-top: 18px; }
|
| 20 |
+
.badge { display: inline-block; padding: 4px 12px; border-radius: 999px; font-size: 13px; margin: 3px; border: 1px solid var(--border); color: var(--muted); }
|
| 21 |
+
.badge.green { color: var(--green); border-color: var(--green); }
|
| 22 |
+
.badge.blue { color: var(--blue); border-color: var(--blue); }
|
| 23 |
+
h2 { font-size: 24px; margin: 56px 0 20px; padding-bottom: 10px; border-bottom: 1px solid var(--border); }
|
| 24 |
+
h2 .num { color: var(--blue); margin-right: 10px; font-family: ui-monospace, monospace; }
|
| 25 |
+
table { width: 100%; border-collapse: collapse; margin: 16px 0; font-size: 15px; }
|
| 26 |
+
th, td { padding: 10px 14px; text-align: left; border: 1px solid var(--border); }
|
| 27 |
+
th { background: var(--card); color: var(--muted); font-weight: 600; }
|
| 28 |
+
tr:nth-child(even) td { background: rgba(255,255,255,0.02); }
|
| 29 |
+
.hl { color: var(--green); font-weight: 700; }
|
| 30 |
+
.cards { display: grid; grid-template-columns: repeat(auto-fit, minmax(220px, 1fr)); gap: 14px; margin: 18px 0; }
|
| 31 |
+
.card { background: var(--card); border: 1px solid var(--border); border-radius: 10px; padding: 18px; }
|
| 32 |
+
.card .k { color: var(--muted); font-size: 13px; text-transform: uppercase; letter-spacing: .05em; }
|
| 33 |
+
.card .v { font-size: 21px; font-weight: 700; margin-top: 4px; }
|
| 34 |
+
.card .s { color: var(--muted); font-size: 13px; margin-top: 4px; }
|
| 35 |
+
.traj { display: grid; grid-template-columns: repeat(auto-fit, minmax(300px, 1fr)); gap: 16px; margin: 20px 0; }
|
| 36 |
+
.step { background: var(--card); border: 1px solid var(--border); border-radius: 10px; overflow: hidden; }
|
| 37 |
+
.step img { width: 100%; display: block; aspect-ratio: 16/9; object-fit: cover; }
|
| 38 |
+
.step .meta { padding: 12px 14px; }
|
| 39 |
+
.step .t { color: var(--muted); font-size: 12px; }
|
| 40 |
+
.step .a { font-family: ui-monospace, "SF Mono", monospace; font-size: 13px; color: var(--gold); margin-top: 4px; word-break: break-all; }
|
| 41 |
+
pre { background: var(--card); border: 1px solid var(--border); border-radius: 10px; padding: 16px 18px; overflow-x: auto; font-size: 13.5px; line-height: 1.7; }
|
| 42 |
+
code { font-family: ui-monospace, "SF Mono", monospace; }
|
| 43 |
+
p code, li code { background: rgba(255,255,255,0.07); padding: 2px 6px; border-radius: 5px; font-size: 13px; color: var(--gold); }
|
| 44 |
+
.note { background: rgba(88,166,255,0.08); border: 1px solid rgba(88,166,255,0.3); border-radius: 10px; padding: 14px 18px; margin: 18px 0; font-size: 14.5px; }
|
| 45 |
+
ul { margin: 10px 0 10px 22px; }
|
| 46 |
+
li { margin: 6px 0; }
|
| 47 |
+
a { color: var(--blue); text-decoration: none; }
|
| 48 |
+
a:hover { text-decoration: underline; }
|
| 49 |
+
.instr { background: rgba(63,185,80,0.08); border: 1px solid rgba(63,185,80,0.35); border-radius: 10px; padding: 14px 18px; margin: 18px 0; font-size: 16px; }
|
| 50 |
+
footer { margin-top: 64px; text-align: center; color: var(--muted); font-size: 13px; }
|
| 51 |
+
</style>
|
| 52 |
+
</head>
|
| 53 |
+
<body>
|
| 54 |
+
<div class="container">
|
| 55 |
+
|
| 56 |
+
<header>
|
| 57 |
+
<div class="emoji">⛏️</div>
|
| 58 |
+
<h1>Minecraft Agent — Qwen3.5-9B</h1>
|
| 59 |
+
<p>A vision-language agent that plays Minecraft from raw first-person pixels (640×360 @ 20 FPS) and emits structured text actions. Stage-3 SFT on 200k+ human gameplay trajectories.</p>
|
| 60 |
+
<div class="badges">
|
| 61 |
+
<span class="badge green">24.9% success (easy-ng, 29-frame context)</span>
|
| 62 |
+
<span class="badge blue">Base: Qwen3.5-9B</span>
|
| 63 |
+
<span class="badge">6M frames · 20 FPS</span>
|
| 64 |
+
<span class="badge">Text-action space</span>
|
| 65 |
+
</div>
|
| 66 |
+
</header>
|
| 67 |
+
|
| 68 |
+
<h2><span class="num">01</span>Model</h2>
|
| 69 |
+
<div class="cards">
|
| 70 |
+
<div class="card"><div class="k">Architecture</div><div class="v">Qwen3.5-9B</div><div class="s">Hybrid linear/full attention + ViT tower</div></div>
|
| 71 |
+
<div class="card"><div class="k">Weights</div><div class="v">17.5 GB</div><div class="s">bf16 · single safetensors</div></div>
|
| 72 |
+
<div class="card"><div class="k">Checkpoint</div><div class="v">step 3000</div><div class="s">run nf-noop2 (keep_p=0.2 + focal 0.75)</div></div>
|
| 73 |
+
<div class="card"><div class="k">License</div><div class="v">Apache-2.0</div><div class="s">Model repo on the Hub</div></div>
|
| 74 |
+
</div>
|
| 75 |
+
<p>➡ <a href="https://huggingface.co/EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3" target="_blank"><strong>EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3</strong></a></p>
|
| 76 |
+
|
| 77 |
+
<h2><span class="num">02</span>Evaluation</h2>
|
| 78 |
+
<p style="color:var(--muted)">Benchmark <b>easy-ng</b>: 202 non-GUI tasks (153 Embodied <code>mine_block</code> + 49 Combat <code>kill_entity</code>) × 3 rollouts, difficulty=easy, 200-step episodes.</p>
|
| 79 |
+
<table>
|
| 80 |
+
<tr><th>Inference history window</th><th>Success</th><th>Embodied</th><th>Combat</th></tr>
|
| 81 |
+
<tr><td>3 frames (naive default)</td><td>15.0%</td><td>17.9%</td><td>6.2%</td></tr>
|
| 82 |
+
<tr><td><b>29 frames (matches training context)</b></td><td class="hl">24.9%</td><td class="hl">24.8%</td><td class="hl">25.2%</td></tr>
|
| 83 |
+
</table>
|
| 84 |
+
<div class="note">💡 <b>Key finding</b>: aligning the inference context length with the 30-step training segments yields <b>+9.9pp</b> over the naive 3-frame window — memory truncation was a hidden bottleneck. Combat more than quadruples (6.2% → 25.2%): tracking an enemy that leaves the field of view requires long-term memory.</div>
|
| 85 |
+
|
| 86 |
+
<h2><span class="num">03</span>Training Recipe</h2>
|
| 87 |
+
<table>
|
| 88 |
+
<tr><th>Component</th><th>Value</th></tr>
|
| 89 |
+
<tr><td>Base model</td><td>Qwen3.5-9B (stage-2)</td></tr>
|
| 90 |
+
<tr><td>Data</td><td><code>minecraft-text-action-dataset-noop-filtered</code> — 92.85% of raw dataset after removing 7.15% pure no-op collapse trajectories</td></tr>
|
| 91 |
+
<tr><td>No-op frame drop (<code>KEEP_NO_OP_P</code>)</td><td><b>0.2</b> (drop 80% of no-op frames at data level)</td></tr>
|
| 92 |
+
<tr><td>Focal loss</td><td>decay = 0.75 (down-weights repeated consecutive actions)</td></tr>
|
| 93 |
+
<tr><td>Sample format</td><td>30-step trajectory segments: <code>user(prompt+instruction+img) → assistant(action) → user(img) → …</code></td></tr>
|
| 94 |
+
</table>
|
| 95 |
+
|
| 96 |
+
<h2><span class="num">04</span>Action Space</h2>
|
| 97 |
+
<p>The model outputs a single line per step:</p>
|
| 98 |
+
<pre>Action: move(dx, dy) and press(keys) and click(button)</pre>
|
| 99 |
+
<ul>
|
| 100 |
+
<li><code>move(dx, dy)</code> — mouse movement (horizontal, vertical)</li>
|
| 101 |
+
<li><code>press(keys)</code> — <code>w/a/s/d</code> movement, <code>space</code> jump, <code>e</code> inventory, <code>1</code>–<code>9</code> hotbar, <code>left.control</code> sprint, <code>left.shift</code> careful move</li>
|
| 102 |
+
<li><code>click('left')</code> attack / <code>click('right')</code> place or use</li>
|
| 103 |
+
<li><code>no_op</code> — wait</li>
|
| 104 |
+
</ul>
|
| 105 |
+
|
| 106 |
+
<h2><span class="num">05</span>A Real Trajectory from Training Data</h2>
|
| 107 |
+
<div class="instr">🎯 Task instruction: <b>Mine the cobweb to clear the path.</b></div>
|
| 108 |
+
<p style="color:var(--muted)">Six frames (evenly sampled from a 30-step segment) with the ground-truth actions the model learns to imitate:</p>
|
| 109 |
+
<div class="traj">
|
| 110 |
+
<div class="step"><img src="assets/frame_0.jpg" alt="frame 0"><div class="meta"><div class="t">step 0</div><div class="a">Action: move(-53, 0) and press(a)</div></div></div>
|
| 111 |
+
<div class="step"><img src="assets/frame_1.jpg" alt="frame 6"><div class="meta"><div class="t">step 6</div><div class="a">Action: move(0, 0) and press(w, a)</div></div></div>
|
| 112 |
+
<div class="step"><img src="assets/frame_2.jpg" alt="frame 12"><div class="meta"><div class="t">step 12</div><div class="a">Action: move(13, 13) and press(w)</div></div></div>
|
| 113 |
+
<div class="step"><img src="assets/frame_3.jpg" alt="frame 18"><div class="meta"><div class="t">step 18</div><div class="a">Action: move(80, 0) and press(d)</div></div></div>
|
| 114 |
+
<div class="step"><img src="assets/frame_4.jpg" alt="frame 24"><div class="meta"><div class="t">step 24</div><div class="a">Action: move(7, -7) and press(w, d, left.control)</div></div></div>
|
| 115 |
+
<div class="step"><img src="assets/frame_5.jpg" alt="frame 29"><div class="meta"><div class="t">step 29</div><div class="a">Action: move(0, 0) and press(w, left.control)</div></div></div>
|
| 116 |
+
</div>
|
| 117 |
+
|
| 118 |
+
<h2><span class="num">06</span>Inference</h2>
|
| 119 |
+
<pre># vLLM
|
| 120 |
+
vllm serve EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3 \
|
| 121 |
+
--limit-mm-per-prompt '{"image": 30}' \
|
| 122 |
+
--enable-prefix-caching \
|
| 123 |
+
--max-model-len 32768</pre>
|
| 124 |
+
|
| 125 |
+
<div class="note">⚠️ GUI tasks (crafting / smelting / chest interaction) are out of scope: all text-action models score 0% on them — the action space has no interface-coordinate grounding.</div>
|
| 126 |
+
|
| 127 |
+
<footer>
|
| 128 |
+
Minecraft Agent · Qwen3.5-9B Stage3 · easy-ng benchmark · single seed<br>
|
| 129 |
+
<a href="https://huggingface.co/EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3">Model repository</a>
|
| 130 |
+
</footer>
|
| 131 |
+
|
| 132 |
+
</div>
|
| 133 |
+
</body>
|
| 134 |
</html>
|