Abstract
EEG foundation models hold promise for scalable brain-signal decoding across clinical and cognitive neuroscience applications, yet their pre-training pipelines remain poorly understood. Among design choices, the masking strategy is particularly critical: it determines what the network must predict and from which context. Yet it has never been ablated in isolation, as each new model bundles a new masking strategy with a new backbone and objective. In this paper, we formalize the design choices for spatio-temporal masking strategies and train various models with a single pipeline under varying masking configurations across two SSL frameworks (MAE and JEPA). We then systematically evaluate the resulting 58 pre-trained models on the 12 datasets of OpenEEGBench under a linear probe. Both frameworks agree on an optimal masking configuration and on shared failure modes. Outside these, performance is robust: 11 MAE and 9 JEPA configurations are statistically indistinguishable from the best. We further identify a novel JEPA-specific failure mode, tagged bias-inflation collapse, invisible to standard detectors. With a well-chosen mask, our pipeline reaches REVE-level downstream performance at a fraction of REVE's pre-training compute.
Community
What masking geometry works best for EEG foundation models?
In this paper, we present a controlled evaluation across the MAE and JEPA frameworks.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models (2026)
- Adaptive Anisotropic Attention for Axis-Structured Signals (2026)
- MANAS-2: Constrained Reconstruction for EEG Foundation Models (2026)
- Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks (2026)
- STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding (2026)
- ERP-FM: A Foundation Model for Universal ERP Analysis (2026)
- EEG-PRIME: Prototype-Aligned Representation Learning with Multi-Level Conditioning for EEG Decoding (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.33487 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 58
PierreGtch/eeg-fm-masking_mae_rone_L1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper