neurorvq-tokenizer-eeg-pretrained

Weights of the NeuroRVQ-EEG tokenizer (four-scale encoder, residual vector quantizers, decoder) for braindecode.models.NeuroRVQTokenizer (modality="eeg"), converted from the authors' release. All weights are pretrained; model(x) returns the per-window z-scored target and reconstruction, model.tokenize(x) the codes.

from braindecode.models import NeuroRVQTokenizer
model = NeuroRVQTokenizer.from_pretrained("braindecode/neurorvq-tokenizer-eeg-pretrained", chs_info=raw.info["chs"])

Channel names must come from the model's EEG channel list (see the class docstring). The channels and window in config.json (19 EEG channels (10-20), 800 samples at 200 Hz) are only a default; pass chs_info (or channel_names and n_chans) and n_times. Input is expected at that sampling rate, preprocessed as in the authors' examples; the model does not preprocess.

Source and conversion

  • Source: ntinosbarmpas/NeuroRVQ at revision d944b87f44ae0ba2923b2f10d0518f23f6803b76, file pretrained_models/tokenizers/NeuroRVQ_EEG_tokenizer_v1.pt (sha256 d3e850e160b1a558c529466b1c0b8cebe8888a5e02824979886dd226187b2725), CC BY-NC 4.0. Code: KonstantinosBarmpas/NeuroRVQ.
  • convert_neurorvq_checkpoint.py (in this repository) renames the Transformer feed-forward mlp.fc1/mlp.fc2 keys to braindecode's mlp.0/mlp.2, drops the pretraining-only tensors (mask_token, norm_pre, head_pre_*) and writes config.json, model.safetensors and pytorch_model.bin with save_pretrained.
  • The converted model's outputs equal the authors' module loading the original file (max-abs difference 0.0 on random inputs).
  • Requires a braindecode version newer than 1.8.1.

Citation

@misc{neurorvq,
  title         = {NeuroRVQ: Multi-Scale Biosignal Tokenization for Generative Foundation Models},
  author        = {Konstantinos Barmpas and Na Lee and Dimitrios Chalatsis and William Raftery and
                   Yannis Panagakis and Dimitrios A. Adamos and Nikolaos Laskaris and
                   Alexandros Koliousis and Dario Farina and Stefanos Zafeiriou},
  year          = {2026},
  eprint        = {2510.13068},
  archivePrefix = {arXiv},
  primaryClass  = {cs.LG},
  url           = {https://arxiv.org/abs/2510.13068},
}

@article{aristimunha2025braindecode,
  title   = {Braindecode: a deep learning library for raw electrophysiological data},
  author  = {Aristimunha, Bruno and others},
  journal = {Zenodo},
  year    = {2025},
  doi     = {10.5281/zenodo.17699192},
}

License

CC BY-NC 4.0 (Attribution-NonCommercial), as the original NeuroRVQ release: non-commercial use only, with attribution to Barmpas et al. and the source repository above.

Downloads last month
73
Safetensors
Model size
76M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for braindecode/neurorvq-tokenizer-eeg-pretrained