- probe.linear_cka is NaN (not 0/0) for a representation that is the same
for every event; compare_encoders.py writes it as null in strict JSON and
names the encoders.
- compare_encoders.py rejects --encoders entries without label= and
repeated labels, draws its events with data.seed (no --seed), and sets
model.pretrained on the loaded config instead of re-parsing YAML.
- Layer-wise embeddings come from the encoders: ObjectTransformer
.encode_layers (forward returns its last) and jepa.layer_event_embeddings
(the edge network's mean node states via _mean_by_group), replacing the
forward hooks and copied pooling in probe.py.
- Tests: CKA of constant representations, cross-encoder and layer-wise
values of the script, and its argument errors.
Model outputs and existing results are unchanged.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
probe.linear_cka and probe.layer_embeddings, and
scripts/compare_encoders.py: CKA of the event embeddings of several
encoders of one architecture (pretrained with JEPA, contrastive, masked
objects or supervision, or random), and layer by layer against the first,
as in Ho et al. (2026). Tested on fixtures for both backbones.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat: tabular in-context models, LoRA meta-training, pretraining objectives and probes
In-context models (tabular.py):
- TabPFN-3.5 meta-trained on the PFN's Delphes tasks (model.name: tabpfn,
task.name: pfn), LoRA on its 24 in-context blocks by default
(model.lora_rank; 0 trains all weights); checkpoints hold only trained
weights. configs/delphes_tabpfn.yaml.
- TabICLv2 (BSD-3) as released and meta-trained the same way
(configs/gamgam_tabicl.yaml, configs/delphes_tabicl.yaml); LoRA is a
weight parametrization, as TabICL reads fused projections directly.
- TabDPT (Apache-2.0) as released, with optional per-event retrieval of the
context (configs/gamgam_tabdpt.yaml).
- Row options: azimuths from the leading object (model.relative_phi), pair
masses and Delta R (model.pair_objects); encoder embeddings instead of or
beside rows (model.tabular_inputs).
- model.tabpfn_checkpoint; evaluate records setup/inference seconds and
CUDA peak memory.
Pretraining (all label-free, encoders load as JEPA's):
- contrastive.py: SimCLR with physics augmentations
(configs/…