sbd-sql-decoder / README.md
johnathan2023's picture
step-through viewer over recorded decoder traces
677dc0b verified
|
Raw History Blame Contribute Delete
1.07 kB
---
title: Set Block Decoding
emoji: ⚡
colorFrom: gray
colorTo: indigo
sdk: static
app_file: index.html
pinned: false
license: apache-2.0
models:
- belumind/sbd-sql-0.5b
---
# Set Block Decoding, step by step
Step through real decoding runs of [`belumind/sbd-sql-0.5b`](https://huggingface.co/belumind/sbd-sql-0.5b):
one 0.5B model proposing a block of tokens past the frontier and verifying every one of them exactly.
Each token is coloured by where the accepted proposal came from — the causal NTP frontier, the
masked block (MATP), or an n-gram copied out of the prompt — and rollbacks show the verifier
refusing a guess and committing the true conditional instead.
These are **recorded runs, not live inference**: every step is a real `sbd_generate` call executed on
an A100 in bf16 and logged forward pass by forward pass. The tracer was checked against the shipped
decoder and reproduces it token for token. For live generation, run
[`demo/demo_colab.ipynb`](https://huggingface.co/belumind/sbd-sql-0.5b/blob/main/demo/demo_colab.ipynb)
on a Colab GPU.