|
Download code/offload/dspark/probabilistic/pp3/VALIDATION.md from ProprietaryLegal/dsv41-sampled-drafting: direct link, hf CLI and curl.
- Browser
- Download file 4.58 kB
-
https://huggingface.co/ProprietaryLegal/dsv41-sampled-drafting/resolve/main/code/offload/dspark/probabilistic/pp3/VALIDATION.md
- Command line
-
hf download hf://ProprietaryLegal/dsv41-sampled-drafting/code/offload/dspark/probabilistic/pp3/VALIDATION.md
-
curl -L -o VALIDATION.md https://huggingface.co/ProprietaryLegal/dsv41-sampled-drafting/resolve/main/code/offload/dspark/probabilistic/pp3/VALIDATION.md
4.58 kB
| # PP3 validation and reproduction | |
| GPU evidence is synthetic, aggregate and hash-bound. No weights, prompts, | |
| private captures or generated text were moved. Actual image sampler math was | |
| loaded with package-only import shims, avoiding a vLLM engine/platform import; | |
| Gumbel, Philox and watermark definitions are the real pinned source files. | |
| Watermark execution is forbidden in the experiment. | |
| - [producer-final.json](producer-final.json): B1–B4, fixed depth4/5,100 event | |
| repetitions of ten graph-replayed selector rounds. Three warmups. Comparator | |
| is torch argmax on identical already-conditioned synthetic BF16 logits. | |
| - [gpu-qualification.json](gpu-qualification.json): five fixed toy targets, | |
| 20K requests each, family chi-square alpha1e-5; p-values .972743/.923190/ | |
| .537776/.045524/.600565. Every emitted T0 token and sampled length matches | |
| the image's point-mass path (100K paired requests). Checks include sparse | |
| full-target tails, disjoint support, equal q, invalidated proposals, ID ties, | |
| signed zero, request permutation, NaN/+inf/all-masked logits and tau0. | |
| - [oracle-bridge.json](oracle-bridge.json): actual GPU-emitted integer q counts | |
| under four synthetic policies passed PP1's exact rational full-target law. | |
| - CPU tests exercise q corruption/missing mass/CRC, malformed support even on | |
| zero-q rows, generation/stale sequence, request ownership, mixed T0/T1 and | |
| failed rounds through the real thread/process proxy, pinned overlay mismatch | |
| and overwrite refusal, admission guards and cost-input provenance. | |
| The original fixture-cardinality mistake and comparison of undefined sampler | |
| padding were corrected to their actual mathematical/API contracts; no production | |
| assertion, statistical threshold or skip was relaxed. First full-suite decode | |
| failures were fixed at their source. A final review moved RNG execution behind | |
| positive-temperature admission. All GPU receipts were rerun after that change. | |
| Historical producer-initial/topk files remain explicitly superseded diagnostics. | |
| All CPU commands use required miniconda Python, CUDA hidden, no pytest cache, | |
| bytecode disabled and temporary/type caches under designated scratch. The final | |
| campaign validation log contains full regression count and the existing optional | |
| local-libofl skip; new tests introduce no skips. Strict mypy covers nine new | |
| runtime files with explicit Triton JIT boundary stubs. Existing legacy worker/ | |
| proxy modules are not claimed newly strict-typed in their entirety. New host | |
| APIs are typed; Triton value specialization uses explicit dynamic tensor types. | |
| ```bash | |
| source ~/.config/ndm/paths.sh | |
| export CUDA_VISIBLE_DEVICES= PYTHONDONTWRITEBYTECODE=1 | |
| export OMP_NUM_THREADS=8 MKL_NUM_THREADS=8 OPENBLAS_NUM_THREADS=8 | |
| PP3_SCRATCH=/opt/dsv41/campaigns/DSV41-OFFLOAD/scratch/PP3 | |
| mkdir -p "$PP3_SCRATCH/tmux" | |
| export TMPDIR="$PP3_SCRATCH" TMUX_TMPDIR="$PP3_SCRATCH/tmux" | |
| /home/operator/miniconda3/bin/python3 -m pytest -q -rs -p no:cacheprovider \ | |
| --basetemp="$PP3_SCRATCH/tests" offload/dspark/spark/tests \ | |
| offload/dspark/probabilistic/tests offload/dspark/probabilistic/pp3/tests | |
| MYPYPATH=offload/dspark/probabilistic/pp3/typings \ | |
| /home/operator/miniconda3/bin/python3 -m mypy --strict --follow-imports=skip \ | |
| --cache-dir="$PP3_SCRATCH/mypy" \ | |
| offload/dspark/worker/sample_policy.py offload/dspark/worker/sampled.py \ | |
| offload/dspark/worker/tools/pp3_probe.py \ | |
| offload/dspark/spark/remote_dspark/sampled_wire.py \ | |
| offload/dspark/spark/remote_dspark/probability_buffers.py \ | |
| offload/dspark/probabilistic/pp3/prepare_verifier.py \ | |
| offload/dspark/probabilistic/pp3/gpu_qualify.py \ | |
| offload/dspark/probabilistic/pp3/estimate.py \ | |
| offload/dspark/probabilistic/pp3/oracle_bridge.py | |
| ``` | |
| GPU commands run only on x86host, detached in a private named PP3 tmux, under | |
| its bc62df2a nonblocking flock, taskset12–15,28–31/nice19, eight threads,225W. | |
| Use the locked wrapper with `--qualify` or `--oracle`; ordinary invocation runs | |
| the selector probe. It uses the required CPython3.13 interpreter, not production's | |
| CPython3.12 environment. Copy code only into x86host PP3 scratch and prepare pinned | |
| sampler sources/overlays there. See [INTEGRATION.md](INTEGRATION.md). | |
| Clean only PP3's own scratch, private test sessions and generated bytecode at | |
| close. Do not change a service/power limit, kill a foreign process, push/merge, | |
| write memory/SESSION_LOG or touch another lane/window. Reproduction creates | |
| fresh evidence; preserve the original measured receipts rather than silently | |
| replacing their hashes. The committed source-provenance test checks this run. | |