EmberJin commited on
Commit
e8989ed
·
verified ·
1 Parent(s): 63389bd

Upload index.html with huggingface_hub

Browse files
Files changed (1) hide show
  1. index.html +133 -18
index.html CHANGED
@@ -1,19 +1,134 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  </html>
 
1
+ <!DOCTYPE html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="UTF-8">
5
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
6
+ <title>Minecraft Agent — Qwen3.5-9B</title>
7
+ <style>
8
+ :root {
9
+ --bg: #0d1117; --card: #161b22; --border: #30363d;
10
+ --text: #e6edf3; --muted: #8b949e; --green: #3fb950; --blue: #58a6ff; --gold: #d29922;
11
+ }
12
+ * { margin: 0; padding: 0; box-sizing: border-box; }
13
+ body { background: var(--bg); color: var(--text); font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif; line-height: 1.6; }
14
+ .container { max-width: 1080px; margin: 0 auto; padding: 0 24px 80px; }
15
+ header { text-align: center; padding: 64px 0 40px; }
16
+ header .emoji { font-size: 56px; }
17
+ h1 { font-size: 36px; margin: 12px 0 8px; }
18
+ header p { color: var(--muted); font-size: 17px; max-width: 640px; margin: 0 auto; }
19
+ .badges { margin-top: 18px; }
20
+ .badge { display: inline-block; padding: 4px 12px; border-radius: 999px; font-size: 13px; margin: 3px; border: 1px solid var(--border); color: var(--muted); }
21
+ .badge.green { color: var(--green); border-color: var(--green); }
22
+ .badge.blue { color: var(--blue); border-color: var(--blue); }
23
+ h2 { font-size: 24px; margin: 56px 0 20px; padding-bottom: 10px; border-bottom: 1px solid var(--border); }
24
+ h2 .num { color: var(--blue); margin-right: 10px; font-family: ui-monospace, monospace; }
25
+ table { width: 100%; border-collapse: collapse; margin: 16px 0; font-size: 15px; }
26
+ th, td { padding: 10px 14px; text-align: left; border: 1px solid var(--border); }
27
+ th { background: var(--card); color: var(--muted); font-weight: 600; }
28
+ tr:nth-child(even) td { background: rgba(255,255,255,0.02); }
29
+ .hl { color: var(--green); font-weight: 700; }
30
+ .cards { display: grid; grid-template-columns: repeat(auto-fit, minmax(220px, 1fr)); gap: 14px; margin: 18px 0; }
31
+ .card { background: var(--card); border: 1px solid var(--border); border-radius: 10px; padding: 18px; }
32
+ .card .k { color: var(--muted); font-size: 13px; text-transform: uppercase; letter-spacing: .05em; }
33
+ .card .v { font-size: 21px; font-weight: 700; margin-top: 4px; }
34
+ .card .s { color: var(--muted); font-size: 13px; margin-top: 4px; }
35
+ .traj { display: grid; grid-template-columns: repeat(auto-fit, minmax(300px, 1fr)); gap: 16px; margin: 20px 0; }
36
+ .step { background: var(--card); border: 1px solid var(--border); border-radius: 10px; overflow: hidden; }
37
+ .step img { width: 100%; display: block; aspect-ratio: 16/9; object-fit: cover; }
38
+ .step .meta { padding: 12px 14px; }
39
+ .step .t { color: var(--muted); font-size: 12px; }
40
+ .step .a { font-family: ui-monospace, "SF Mono", monospace; font-size: 13px; color: var(--gold); margin-top: 4px; word-break: break-all; }
41
+ pre { background: var(--card); border: 1px solid var(--border); border-radius: 10px; padding: 16px 18px; overflow-x: auto; font-size: 13.5px; line-height: 1.7; }
42
+ code { font-family: ui-monospace, "SF Mono", monospace; }
43
+ p code, li code { background: rgba(255,255,255,0.07); padding: 2px 6px; border-radius: 5px; font-size: 13px; color: var(--gold); }
44
+ .note { background: rgba(88,166,255,0.08); border: 1px solid rgba(88,166,255,0.3); border-radius: 10px; padding: 14px 18px; margin: 18px 0; font-size: 14.5px; }
45
+ ul { margin: 10px 0 10px 22px; }
46
+ li { margin: 6px 0; }
47
+ a { color: var(--blue); text-decoration: none; }
48
+ a:hover { text-decoration: underline; }
49
+ .instr { background: rgba(63,185,80,0.08); border: 1px solid rgba(63,185,80,0.35); border-radius: 10px; padding: 14px 18px; margin: 18px 0; font-size: 16px; }
50
+ footer { margin-top: 64px; text-align: center; color: var(--muted); font-size: 13px; }
51
+ </style>
52
+ </head>
53
+ <body>
54
+ <div class="container">
55
+
56
+ <header>
57
+ <div class="emoji">⛏️</div>
58
+ <h1>Minecraft Agent — Qwen3.5-9B</h1>
59
+ <p>A vision-language agent that plays Minecraft from raw first-person pixels (640×360 @ 20 FPS) and emits structured text actions. Stage-3 SFT on 200k+ human gameplay trajectories.</p>
60
+ <div class="badges">
61
+ <span class="badge green">24.9% success (easy-ng, 29-frame context)</span>
62
+ <span class="badge blue">Base: Qwen3.5-9B</span>
63
+ <span class="badge">6M frames · 20 FPS</span>
64
+ <span class="badge">Text-action space</span>
65
+ </div>
66
+ </header>
67
+
68
+ <h2><span class="num">01</span>Model</h2>
69
+ <div class="cards">
70
+ <div class="card"><div class="k">Architecture</div><div class="v">Qwen3.5-9B</div><div class="s">Hybrid linear/full attention + ViT tower</div></div>
71
+ <div class="card"><div class="k">Weights</div><div class="v">17.5 GB</div><div class="s">bf16 · single safetensors</div></div>
72
+ <div class="card"><div class="k">Checkpoint</div><div class="v">step 3000</div><div class="s">run nf-noop2 (keep_p=0.2 + focal 0.75)</div></div>
73
+ <div class="card"><div class="k">License</div><div class="v">Apache-2.0</div><div class="s">Model repo on the Hub</div></div>
74
+ </div>
75
+ <p>➡ &nbsp;<a href="https://huggingface.co/EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3" target="_blank"><strong>EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3</strong></a></p>
76
+
77
+ <h2><span class="num">02</span>Evaluation</h2>
78
+ <p style="color:var(--muted)">Benchmark <b>easy-ng</b>: 202 non-GUI tasks (153 Embodied <code>mine_block</code> + 49 Combat <code>kill_entity</code>) × 3 rollouts, difficulty=easy, 200-step episodes.</p>
79
+ <table>
80
+ <tr><th>Inference history window</th><th>Success</th><th>Embodied</th><th>Combat</th></tr>
81
+ <tr><td>3 frames (naive default)</td><td>15.0%</td><td>17.9%</td><td>6.2%</td></tr>
82
+ <tr><td><b>29 frames (matches training context)</b></td><td class="hl">24.9%</td><td class="hl">24.8%</td><td class="hl">25.2%</td></tr>
83
+ </table>
84
+ <div class="note">💡 <b>Key finding</b>: aligning the inference context length with the 30-step training segments yields <b>+9.9pp</b> over the naive 3-frame window — memory truncation was a hidden bottleneck. Combat more than quadruples (6.2% → 25.2%): tracking an enemy that leaves the field of view requires long-term memory.</div>
85
+
86
+ <h2><span class="num">03</span>Training Recipe</h2>
87
+ <table>
88
+ <tr><th>Component</th><th>Value</th></tr>
89
+ <tr><td>Base model</td><td>Qwen3.5-9B (stage-2)</td></tr>
90
+ <tr><td>Data</td><td><code>minecraft-text-action-dataset-noop-filtered</code> — 92.85% of raw dataset after removing 7.15% pure no-op collapse trajectories</td></tr>
91
+ <tr><td>No-op frame drop (<code>KEEP_NO_OP_P</code>)</td><td><b>0.2</b> (drop 80% of no-op frames at data level)</td></tr>
92
+ <tr><td>Focal loss</td><td>decay = 0.75 (down-weights repeated consecutive actions)</td></tr>
93
+ <tr><td>Sample format</td><td>30-step trajectory segments: <code>user(prompt+instruction+img) → assistant(action) → user(img) → …</code></td></tr>
94
+ </table>
95
+
96
+ <h2><span class="num">04</span>Action Space</h2>
97
+ <p>The model outputs a single line per step:</p>
98
+ <pre>Action: move(dx, dy) and press(keys) and click(button)</pre>
99
+ <ul>
100
+ <li><code>move(dx, dy)</code> — mouse movement (horizontal, vertical)</li>
101
+ <li><code>press(keys)</code> — <code>w/a/s/d</code> movement, <code>space</code> jump, <code>e</code> inventory, <code>1</code>–<code>9</code> hotbar, <code>left.control</code> sprint, <code>left.shift</code> careful move</li>
102
+ <li><code>click('left')</code> attack / <code>click('right')</code> place or use</li>
103
+ <li><code>no_op</code> — wait</li>
104
+ </ul>
105
+
106
+ <h2><span class="num">05</span>A Real Trajectory from Training Data</h2>
107
+ <div class="instr">🎯 Task instruction: <b>Mine the cobweb to clear the path.</b></div>
108
+ <p style="color:var(--muted)">Six frames (evenly sampled from a 30-step segment) with the ground-truth actions the model learns to imitate:</p>
109
+ <div class="traj">
110
+ <div class="step"><img src="assets/frame_0.jpg" alt="frame 0"><div class="meta"><div class="t">step 0</div><div class="a">Action: move(-53, 0) and press(a)</div></div></div>
111
+ <div class="step"><img src="assets/frame_1.jpg" alt="frame 6"><div class="meta"><div class="t">step 6</div><div class="a">Action: move(0, 0) and press(w, a)</div></div></div>
112
+ <div class="step"><img src="assets/frame_2.jpg" alt="frame 12"><div class="meta"><div class="t">step 12</div><div class="a">Action: move(13, 13) and press(w)</div></div></div>
113
+ <div class="step"><img src="assets/frame_3.jpg" alt="frame 18"><div class="meta"><div class="t">step 18</div><div class="a">Action: move(80, 0) and press(d)</div></div></div>
114
+ <div class="step"><img src="assets/frame_4.jpg" alt="frame 24"><div class="meta"><div class="t">step 24</div><div class="a">Action: move(7, -7) and press(w, d, left.control)</div></div></div>
115
+ <div class="step"><img src="assets/frame_5.jpg" alt="frame 29"><div class="meta"><div class="t">step 29</div><div class="a">Action: move(0, 0) and press(w, left.control)</div></div></div>
116
+ </div>
117
+
118
+ <h2><span class="num">06</span>Inference</h2>
119
+ <pre># vLLM
120
+ vllm serve EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3 \
121
+ --limit-mm-per-prompt '{"image": 30}' \
122
+ --enable-prefix-caching \
123
+ --max-model-len 32768</pre>
124
+
125
+ <div class="note">⚠️ GUI tasks (crafting / smelting / chest interaction) are out of scope: all text-action models score 0% on them — the action space has no interface-coordinate grounding.</div>
126
+
127
+ <footer>
128
+ Minecraft Agent · Qwen3.5-9B Stage3 · easy-ng benchmark · single seed<br>
129
+ <a href="https://huggingface.co/EmberJin/Minecraft-Agent-Qwen3.5-9B-Stage3">Model repository</a>
130
+ </footer>
131
+
132
+ </div>
133
+ </body>
134
  </html>