GUI-Decisions / intro.html
infinitylogesh's picture
GUI-Decisions Space
8056215 verified
Raw History Blame
1.05 kB
<div class="amb-head">
<p class="eyebrow">Slot reading 路 GUI-Decisions</p>
<p class="title">Computer-use steps, <span class="fast">read</span> in one forward pass</p>
<p class="lede">Give it a screenshot and an instruction. Instead of <em>writing</em> <code>{"action": "click", "point": [412, 288]}</code>
token by token, the model fills a fixed template of slots, and every answer is read from one forward pass: the action, and the
point as a 256-bin distribution over x and over y. Nothing is decoded; the heatmap is that distribution.</p>
<p class="links">
<a href="https://logeshumapathi.com/blog/2026/10/06/slot-reading.html">blog post</a> 路
<a href="https://github.com/infinitylogesh/gui-decisions">code</a> 路
<a href="https://huggingface.co/infinitylogesh/GUI-Decisions-31B-LoRA">GUI-Decisions-31B-LoRA</a> 路
<a href="https://huggingface.co/infinitylogesh/GUI-Decisions-31B">GUI-Decisions-31B</a> 路
<a href="https://huggingface.co/infinitylogesh/GUI-Decisions-2B-LoRA">GUI-Decisions-2B-LoRA</a>
</p>
</div>