File size: 1,053 Bytes
8056215
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
<div class="amb-head">
  <p class="eyebrow">Slot reading 路 GUI-Decisions</p>
  <p class="title">Computer-use steps, <span class="fast">read</span> in one forward pass</p>
  <p class="lede">Give it a screenshot and an instruction. Instead of <em>writing</em> <code>{"action": "click", "point": [412, 288]}</code>
  token by token, the model fills a fixed template of slots, and every answer is read from one forward pass: the action, and the
  point as a 256-bin distribution over x and over y. Nothing is decoded; the heatmap is that distribution.</p>
  <p class="links">
    <a href="https://logeshumapathi.com/blog/2026/10/06/slot-reading.html">blog post</a> 路
    <a href="https://github.com/infinitylogesh/gui-decisions">code</a> 路
    <a href="https://huggingface.co/infinitylogesh/GUI-Decisions-31B-LoRA">GUI-Decisions-31B-LoRA</a> 路
    <a href="https://huggingface.co/infinitylogesh/GUI-Decisions-31B">GUI-Decisions-31B</a> 路
    <a href="https://huggingface.co/infinitylogesh/GUI-Decisions-2B-LoRA">GUI-Decisions-2B-LoRA</a>
  </p>
</div>