The PFN gains a retrieval head (an attention-weighted vote of the context's
labels), QK-norm with a log-context-size temperature, one key/value head for
queries, joined summary tokens for a wider stage across events, Fourier
input features and context ranks of pT and energy; all off by default.
train.lr_schedule=cosine warms up over train.warmup_epochs. Meta-training
encodes events in object-count buckets, samples tasks in loader workers and
shares each step's context size across DDP ranks; in-context inference
sorts the context and attends in chunks. Task draws differ from earlier
runs (one generator per step). docs/design.md has the GamGam results.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
27 days ago
fix: warm up CUDA graphs again after resuming; test split and all events in label_efficiency
A resumed trainer skipped the eager warmup steps (they counted global
steps), so with train.fast torch.compile compiled during CUDA graph
capture and failed. Count each trainer's own eager steps instead.
scripts/label_efficiency.py takes --events all, --split and
--eval-override.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
refactor: flat modules, one YAML per experiment, no Hydra
Replace the 14 subpackages with 13 flat modules (6.7k -> 2.7k lines),
the Hydra config groups with typed dataclasses and one self-contained
YAML file per experiment (configs/), and the docs with docs/usage.md and
docs/design.md. All capabilities stay: GamGam, ttH CP, Delphes, binary
and multiclass tasks, transformer, fine-tuning from Pretrained_GNN, DDP,
torch.compile/CUDA graphs/bfloat16, predict and ONNX export.
Behavior: prepared caches, pretrained-model logits and two CPU training
epochs are bit-identical to the previous code on the fixtures and a 60k
event GamGam subset. Energies are now computed with one vectorized cosh
(<= 2.4e-7 relative difference on 969 of the full GamGam objects). The
ttH and Delphes configs now use Number % 10 as the fold (the raw event
index selected only the first 10 events), and use the paper recipe
(64/4/4, Adam 1e-4, decay 0.99). The ROOT score writer handles jagged
trees. Prediction files store source file and entry instead of sample
ids, and checkpo…