File size: 6,794 Bytes
e1acc15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
# PP3 pre-registered coordinator A/B window — NOT RUN

Decision now: STOP. This is an execution plan after missing qualification gates
close, not authorization to deploy. ESTIMATED total69minutes; hard ceiling75.
No PP3 lane access to Spark/sparkworker, serving endpoints, production pair/units or
any window directory is authorized or exercised. Coordinator owns every live
operation and the exact restore receipt. No automatic promotion.

## Admission gates

Freeze source commits/hashes and obtain independent review. Qualify the entire
production K2 TP2 sampled path under its actual interpreter/Torch/Triton and
weights; verify B1–B4 at depths4/5, T0 identity, q counts and conditioning, slot
reuse, request permutation, cancel/reset, reconnect, timeout and late reply.
Measure actual exposed added cost including eager/graph differences, Markov,
candidate exchange or full-vocab peer staging, CRC/validation and target work.
The present two-launch selector is .155–.209ms/depth5; it misses the absolute
.05ms objective and is not a speed-qualified implementation.

Reconcile both pinned image sources with live source/image hashes. Prepare
both overlays offline with prepare_verifier, review their diff/receipt, then
use a separate coordinator-approved experimental read-only mount profile.
Ordinary production staging intentionally does not deploy these files. Prove
both ABI markers and engine failure invalidation; trial missing/corrupt q on
both ranks must become target-only. Validate actual grammar/penalty/stop/EOS,
tool JSON and reasoning parser state on the exact engine. Solo histograms and
pure callback oracles do not establish those stateful properties.

Require a conservative cost estimate with positive margin at the family lower
bounds and32K proxy; fill missing terms rather than pricing them at zero.
Measure150K acceptance/cost separately in the bounded window. If any admission
gate fails or evidence is incomplete, do not open the window. The current lane
therefore hands over a NO-GO, plus this reproducible plan for a later revision.

## Frozen arms and schedule

A: current production K2 greedy implementation, worker/engine sampled switches
OFF, standard rejection, fixed depth5. B: same weights, backbone, Markov/cache,
Engram backend, target processors and source build; both explicit sampled
switches ON, top32/tau.7/dyadic24-floor-first-v1, same fixed depth5. Both disable
confidence/adaptive admission, prompt lookup, dynamic depth and depth-file
reload. A remains the existing implementation under the same fixed-depth
experimental setting; do not compare adaptive A against fixed5 B. If depth5 is
unsupported, STOP and register a new fixed4 experiment for both arms.

Keep target T1/top_p1, high reasoning effort, priority10, output budget and
context/KV profile identical. B1 is primary, short/32K/150K occupied contexts
with reasoning/output reserve. Two frozen public task families each provide
one short, one32K and one150K request (six pairs total). Hash input sources,
request/seed/target policy and ordered family assignment before any A/B data;
no use of the development/PP2 fit examples and no prompt/output text in git.
Stochastic texts need not match. T0 uses paired identical prompts/seeds; compare
emitted tokens, not undefined padding past num_sampled.

Interleave **A1/B1/B2/A2** with a separate engine session for each arm block.
Each block runs all six frozen requests in the same predeclared rotating order
with matched seeds/budgets. This uses real restarts with recorded cold/warm
TTFT; changing environment variables in a running engine is not an arm switch.
Do not claim per-round randomized interleaving. Begin every block only after
its worker/engine identity, real warmup rounds and effective target parameters
are attested; no fabricated switch or launcher flags.

ESTIMATED budget69minutes:

| Stage | Minutes | Stop condition |
|---|---:|---|
| Drain/ownership, exact snapshots and rollback preflight |7|No idle/restore ownership receipt: abort|
|A1/B1/B2/A2, each start+warm4, prefix priming4, six bounded decode runs3|44|Any block over11min: truncate the experiment, preserve raw partials|
|Paired greedy and failure/structured smoke within qualified test processes|3|Any semantic mismatch: reject B|
|Restore exact baseline and verify usable service|12|Use existing coordinator rollback escalation|
|Receipt/statistics/close|3|Incomplete data: no promotion|

Decode runs are at most30s each after prefix priming; delivered tokens and
complete target rounds are counted without requiring a fixed token count to
finish after a deadline. Record any truncated full-task observation as censored.
At elapsed50min stop admitting experiment requests and begin restore if any
stage has overrun; preserve12min for restore. Hard75min includes restoration,
not an excuse to leave B running. Longer full-task/extra-family/B4 work requires
a separately registered window; do not expand this window opportunistically.

## Endpoints, measurements and frozen decision

Only coordinator-reviewed experimental endpoints/processes are used, after
production drain/ownership and HOLD checks from COMMON. Exact endpoint and
launcher commands come from the coordinator's live registry; this plan invents
none. Prefix priming is identical across arm blocks, with cold start/prefill
reported separately and exact occupied token counts verified. No new context
limit, GPU power/clock or concurrency setting is permitted.

Collect per-request/source-family/block and per-round IDs: actual delivered
tokens, accepted drafts/round, complete ms/round p50/p95/p99, target verifier and
q costs, TTFT, first visible answer, answer/reasoning counts, bytes, watchdogs,
queue/staging and both-rank synchronization. Include canceled/failed/timeout
requests in the disposition; never drop slow samples. Save unprofiled headline
rates separately from CUDA-event profiling. Check memory/serving health and
request backlog throughout; abort on unexplained failures/pressure.

Pre-registered rule: **REJECT** for any q/target-law, greedy-identity, grammar,
stop, lifecycle, corruption or recovery failure, any lost request, or target
policy/weight mismatch. **NO PROMOTION / INCONCLUSIVE** if incomplete, measured
throughput gain<5%, source-cluster paired90% bootstrap lower bound<=0, or>5%
TTFT/p95-round regression in any context/family. Bootstrap2000 source-cluster
resamples with seed4103; report both task families and the small-family limit,
never treat thousands of rounds as independent sources. Report accepted/round
as a diagnostic; it cannot override delivered throughput or TTFT. Candidate
only if every gate passes, point gain>=5%, lower bound>0 and per-context guards
pass. Even then, independent coordinator approval and promotion are separate.