- data.eval_events: evaluate (validation in training, evaluate, predict,
probe) only that many seeded random validation or test events.
- scripts/label_efficiency.sh, meta_train.sh, pretrain.sh: one-GPU Slurm
wrappers for the sweep, meta-training then in-context sweep, and
pretraining then probes.
- scripts/plot_label_efficiency.py: AUC against labelled events from sweeps
and probes, as PDF/PNG and Markdown/LaTeX tables; optional extra `plots`.
Wrappers smoke-tested outside Slurm on fixtures; tests pass on CPU and MPS.
No change to existing models' results.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat: tabular in-context models, LoRA meta-training, pretraining objectives and probes
In-context models (tabular.py):
- TabPFN-3.5 meta-trained on the PFN's Delphes tasks (model.name: tabpfn,
task.name: pfn), LoRA on its 24 in-context blocks by default
(model.lora_rank; 0 trains all weights); checkpoints hold only trained
weights. configs/delphes_tabpfn.yaml.
- TabICLv2 (BSD-3) as released and meta-trained the same way
(configs/gamgam_tabicl.yaml, configs/delphes_tabicl.yaml); LoRA is a
weight parametrization, as TabICL reads fused projections directly.
- TabDPT (Apache-2.0) as released, with optional per-event retrieval of the
context (configs/gamgam_tabdpt.yaml).
- Row options: azimuths from the leading object (model.relative_phi), pair
masses and Delta R (model.pair_objects); encoder embeddings instead of or
beside rows (model.tabular_inputs).
- model.tabpfn_checkpoint; evaluate records setup/inference seconds and
CUDA peak memory.
Pretraining (all label-free, encoders load as JEPA's):
- contrastive.py: SimCLR with physics augmentations
(configs/…
model.name: jepa with task.name: jepa pretrains the transformer encoder
without labels (I-JEPA): a predictor told only the type and type index of
hidden objects predicts their encodings by an EMA target encoder.
configs/delphes_jepa.yaml uses the 12 Delphes samples and cache of the
supervised pretraining; configs/gamgam_jepa_finetune.yaml fine-tunes the
context encoder on GamGam (model.pretrained=null: from scratch).
TransformerClassifier now wraps an ObjectTransformer encoder.
The Slurm scripts put Hugging Face downloads on scratch (HF_HOME).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
chore: move test fixtures into tests/, flatten scripts/, drop paper source
Replace the 14 subpackages with 13 flat modules (6.7k -> 2.7k lines),
the Hydra config groups with typed dataclasses and one self-contained
YAML file per experiment (configs/), and the docs with docs/usage.md and
docs/design.md. All capabilities stay: GamGam, ttH CP, Delphes, binary
and multiclass tasks, transformer, fine-tuning from Pretrained_GNN, DDP,
torch.compile/CUDA graphs/bfloat16, predict and ONNX export.
Behavior: prepared caches, pretrained-model logits and two CPU training
epochs are bit-identical to the previous code on the fixtures and a 60k
event GamGam subset. Energies are now computed with one vectorized cosh
(<= 2.4e-7 relative difference on 969 of the full GamGam objects). The
ttH and Delphes configs now use Number % 10 as the fold (the raw event
index selected only the first 10 events), and use the paper recipe
(64/4/4, Adam 1e-4, decay 0.99). The ROOT score writer handles jagged
trees. Prediction files store source file and entry instead of sample
ids, and checkpo…
chore: remove legacy parity, validation harness, benchmarks and release tooling
The rewrite is complete; the frozen DGL/legacy references, the validation
harness, benchmarks, CI, agent skills, release tooling, migration history
and changelog are no longer needed.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs: make the ATLAS Open Data GamGam task the main benchmark
Document the GamGam workflow, the new data, checkpoint, loader, and speed
options, and the intentional differences in docs/migration.md. Slurm
wrappers now use a scratch uv cache, which compute nodes can lock. Add an
ensemble summary script.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat: add the ATLAS Open Data GamGam 5-class task and faster training
Add the Higgs production multiclass task of Ho et al. (2026), Table 3:
ttH, ggF, VBF, WH, ZH from the ATLAS Open Data 13 TeV GamGam MC, pinned to
a Hugging Face dataset revision.
Data:
- derived branches split ``lep_*`` into electrons and muons and apply the
MV2c10 70% working point, so the pretraining node schema applies
- ``fold_modulus`` derives folds from event numbers in exact integers
- 64-event fixtures of the five samples and an end-to-end workflow test
Training:
- paper recipe (Adam 1e-4, 0.99 decay, stop after 5 epochs without
training-loss improvement) and ``best.pt`` selection by validation AUC
- checkpoint save_every_epochs/save_best/save_last are now honored;
per-epoch history.jsonl; evaluate can write metrics JSON
- macro precision/recall/F1 for multiclass tasks
- O(n log n) weighted ROC AUC on the metric device (was O(P*N) pairs)
Speed (A100, GamGam, batch 1024): about 56 s -> 35 s per epoch by default,
18 s with the opt-in paper_fast preset:
- loader worker pr…
feat: replace DGL with shared packed events and native PyTorch graphs
Track the documented Slurm wrappers that an unanchored slurm/ ignore rule
excluded, move graph-cache preparation from config.application into
graphs.preparation (outputs verified identical to main), archive rewrite
task specs under docs/history, move the paper source under docs/paper,
remove empty scaffolding, and refresh stale transformer documentation.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>