metadata
license: mit
tags:
- e=mc2
- structured-output
- constrained-decoding
- json
- tiny-transformer
- pankhllm
e=mc² Lesson 08: pankh-decider-v1
pankh-decider-v0 (Lesson 07), warm-started and trained to write the operation AND its parameters as compact JSON, e.g. {"op":"kpi_rank","params":{"metric":"calls","level":"territories","n":17,"direction":"top","period":"2025-07"}}. Codes, months and numbers are written as pointers (<code0>) and copied back from the question. A prefix-validity grammar built from pankhllm's router.yaml constrains decoding.
Lesson: https://theaivibe.org/emc2/structured-output-small-model-json-constrained-decoding
| Held-out templates (2,000) | Valid | Exact match | Wrong but valid |
|---|---|---|---|
| Free decoding | 91.6% | 47.3% | 44.4% |
| Catalog stencil | 100.0% | 50.5% | 49.5% |
| Grounded stencil | 100.0% | 71.3% | 28.7% |
Files: lesson_08.ipynb (unexecuted), RESULTS.md, pankh-decider-v1/ (model.pt, config.json, vocab.json). Author: Prateek Singh. MIT.