README.md

metadata

title: Set Block Decoding
emoji: ⚡
colorFrom: gray
colorTo: indigo
sdk: static
app_file: index.html
pinned: false
license: apache-2.0
models:
  - belumind/sbd-sql-0.5b

Set Block Decoding, step by step

Step through real decoding runs of belumind/sbd-sql-0.5b: one 0.5B model proposing a block of tokens past the frontier and verifying every one of them exactly.

Each token is coloured by where the accepted proposal came from — the causal NTP frontier, the masked block (MATP), or an n-gram copied out of the prompt — and rollbacks show the verifier refusing a guess and committing the true conditional instead.

These are recorded runs, not live inference: every step is a real sbd_generate call executed on an A100 in bf16 and logged forward pass by forward pass. The tracer was checked against the shipped decoder and reproduces it token for token. For live generation, run demo/demo_colab.ipynb on a Colab GPU.