Download code/offload/dspark/probabilistic/pp3/LIVE-AB-PLAN.md from ProprietaryLegal/dsv41-sampled-drafting: direct link, hf CLI and curl.
- Browser
- Download file 6.79 kB
-
https://huggingface.co/ProprietaryLegal/dsv41-sampled-drafting/resolve/main/code/offload/dspark/probabilistic/pp3/LIVE-AB-PLAN.md
- Command line
-
hf download hf://ProprietaryLegal/dsv41-sampled-drafting/code/offload/dspark/probabilistic/pp3/LIVE-AB-PLAN.md
-
curl -L -o LIVE-AB-PLAN.md https://huggingface.co/ProprietaryLegal/dsv41-sampled-drafting/resolve/main/code/offload/dspark/probabilistic/pp3/LIVE-AB-PLAN.md
PP3 pre-registered coordinator A/B window — NOT RUN
Decision now: STOP. This is an execution plan after missing qualification gates close, not authorization to deploy. ESTIMATED total69minutes; hard ceiling75. No PP3 lane access to Spark/sparkworker, serving endpoints, production pair/units or any window directory is authorized or exercised. Coordinator owns every live operation and the exact restore receipt. No automatic promotion.
Admission gates
Freeze source commits/hashes and obtain independent review. Qualify the entire production K2 TP2 sampled path under its actual interpreter/Torch/Triton and weights; verify B1–B4 at depths4/5, T0 identity, q counts and conditioning, slot reuse, request permutation, cancel/reset, reconnect, timeout and late reply. Measure actual exposed added cost including eager/graph differences, Markov, candidate exchange or full-vocab peer staging, CRC/validation and target work. The present two-launch selector is .155–.209ms/depth5; it misses the absolute .05ms objective and is not a speed-qualified implementation.
Reconcile both pinned image sources with live source/image hashes. Prepare both overlays offline with prepare_verifier, review their diff/receipt, then use a separate coordinator-approved experimental read-only mount profile. Ordinary production staging intentionally does not deploy these files. Prove both ABI markers and engine failure invalidation; trial missing/corrupt q on both ranks must become target-only. Validate actual grammar/penalty/stop/EOS, tool JSON and reasoning parser state on the exact engine. Solo histograms and pure callback oracles do not establish those stateful properties.
Require a conservative cost estimate with positive margin at the family lower bounds and32K proxy; fill missing terms rather than pricing them at zero. Measure150K acceptance/cost separately in the bounded window. If any admission gate fails or evidence is incomplete, do not open the window. The current lane therefore hands over a NO-GO, plus this reproducible plan for a later revision.
Frozen arms and schedule
A: current production K2 greedy implementation, worker/engine sampled switches OFF, standard rejection, fixed depth5. B: same weights, backbone, Markov/cache, Engram backend, target processors and source build; both explicit sampled switches ON, top32/tau.7/dyadic24-floor-first-v1, same fixed depth5. Both disable confidence/adaptive admission, prompt lookup, dynamic depth and depth-file reload. A remains the existing implementation under the same fixed-depth experimental setting; do not compare adaptive A against fixed5 B. If depth5 is unsupported, STOP and register a new fixed4 experiment for both arms.
Keep target T1/top_p1, high reasoning effort, priority10, output budget and context/KV profile identical. B1 is primary, short/32K/150K occupied contexts with reasoning/output reserve. Two frozen public task families each provide one short, one32K and one150K request (six pairs total). Hash input sources, request/seed/target policy and ordered family assignment before any A/B data; no use of the development/PP2 fit examples and no prompt/output text in git. Stochastic texts need not match. T0 uses paired identical prompts/seeds; compare emitted tokens, not undefined padding past num_sampled.
Interleave A1/B1/B2/A2 with a separate engine session for each arm block. Each block runs all six frozen requests in the same predeclared rotating order with matched seeds/budgets. This uses real restarts with recorded cold/warm TTFT; changing environment variables in a running engine is not an arm switch. Do not claim per-round randomized interleaving. Begin every block only after its worker/engine identity, real warmup rounds and effective target parameters are attested; no fabricated switch or launcher flags.
ESTIMATED budget69minutes:
| Stage | Minutes | Stop condition |
|---|---|---|
| Drain/ownership, exact snapshots and rollback preflight | 7 | No idle/restore ownership receipt: abort |
| A1/B1/B2/A2, each start+warm4, prefix priming4, six bounded decode runs3 | 44 | Any block over11min: truncate the experiment, preserve raw partials |
| Paired greedy and failure/structured smoke within qualified test processes | 3 | Any semantic mismatch: reject B |
| Restore exact baseline and verify usable service | 12 | Use existing coordinator rollback escalation |
| Receipt/statistics/close | 3 | Incomplete data: no promotion |
Decode runs are at most30s each after prefix priming; delivered tokens and complete target rounds are counted without requiring a fixed token count to finish after a deadline. Record any truncated full-task observation as censored. At elapsed50min stop admitting experiment requests and begin restore if any stage has overrun; preserve12min for restore. Hard75min includes restoration, not an excuse to leave B running. Longer full-task/extra-family/B4 work requires a separately registered window; do not expand this window opportunistically.
Endpoints, measurements and frozen decision
Only coordinator-reviewed experimental endpoints/processes are used, after production drain/ownership and HOLD checks from COMMON. Exact endpoint and launcher commands come from the coordinator's live registry; this plan invents none. Prefix priming is identical across arm blocks, with cold start/prefill reported separately and exact occupied token counts verified. No new context limit, GPU power/clock or concurrency setting is permitted.
Collect per-request/source-family/block and per-round IDs: actual delivered tokens, accepted drafts/round, complete ms/round p50/p95/p99, target verifier and q costs, TTFT, first visible answer, answer/reasoning counts, bytes, watchdogs, queue/staging and both-rank synchronization. Include canceled/failed/timeout requests in the disposition; never drop slow samples. Save unprofiled headline rates separately from CUDA-event profiling. Check memory/serving health and request backlog throughout; abort on unexplained failures/pressure.
Pre-registered rule: REJECT for any q/target-law, greedy-identity, grammar, stop, lifecycle, corruption or recovery failure, any lost request, or target policy/weight mismatch. NO PROMOTION / INCONCLUSIVE if incomplete, measured throughput gain<5%, source-cluster paired90% bootstrap lower bound<=0, or>5% TTFT/p95-round regression in any context/family. Bootstrap2000 source-cluster resamples with seed4103; report both task families and the small-family limit, never treat thousands of rounds as independent sources. Report accepted/round as a diagnostic; it cannot override delivered throughput or TTFT. Candidate only if every gate passes, point gain>=5%, lower bound>0 and per-context guards pass. Even then, independent coordinator approval and promotion are separate.