Safetensors
English
BerenMillidge commited on
Commit
7e94ea9
·
verified ·
1 Parent(s): 8bc19f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -10
README.md CHANGED
@@ -6,24 +6,23 @@ language:
6
 
7
  # Model Card for ZUNA
8
 
9
- ZUNA is a 380M-parameter masked diffusion autoencoder trained to reconstruct, denoise, and upsample scalp-EEG signals. ZUNA represents an early effort to build general foundation models of brain signals. Over time, we see these models forming the foundation towards fully thought-to-outcome agentic systems.
10
 
11
  Given a subset of EEG channels, ZUNA can:
 
 
 
12
 
13
- - Denoise existing channels
14
- - Reconstruct missing channels
15
- - Predict novel channel signals given the physical coordinates of electrodes on the scalp
16
 
17
- ZUNA was trained on a dataset of approximately 2 million channel-hours aggregated from various online sources and harmonized with our standardized preprocessing and electrode location standardization pipeline.
18
-
19
- At only 380M parameters, ZUNA can run comfortably on any consumer GPU or even on CPU.
20
 
21
  // TODO channel reconstruction gif
22
 
23
 
24
  ## Performance
25
 
26
- ZUNA significantly outperforms existing standard methods for channel denoising, reconstruction, or upsampling. We compared ZUNA to MNE's default spherical spline interpolation method which is ubiquitous in practice. We find that ZUNA outperforms MNE in reconstruction accuracy across a range of unseen datasets, even those with a different preprocessing pipeline. ZUNAs advantage is particularly striking for higher upsampling ratios, demonstrating that ZUNA is effectively usinggeneral priors it has learned through large-scale pretraining.
27
 
28
  ![2x3_panel](https://cdn-uploads.huggingface.co/production/uploads/65c05e75c084467acab2f84a/zURH5s_AQvNhTDYY66_Yf.png)
29
 
@@ -61,8 +60,6 @@ python 3_tutorial_pt_to_fif.py
61
 
62
  For more information please see our [technical whitepaper](arxiv) and [blog](blog). If you find ZUNA useful in your work please cite as
63
 
64
- TODO citation.
65
-
66
  Organizations or researchers interested in collaborating with Zyphra to improve future versions for specific needs or use cases should contact bci@zyphra.com.
67
 
68
 
 
6
 
7
  # Model Card for ZUNA
8
 
9
+ ZUNA is a 380M-parameter masked diffusion autoencoder trained to reconstruct, denoise, and upsample scalp-EEG signals. ZUNA represents a significant milestone in the development of noninvasive thought-to-text and is an early effort to build general foundation models of brain signals that can be used to understand and decode brain states. Over time, we see these models forming the foundation of thought-to-text agentic systems and a key component in our mission to build human-aligned superintelligence.
10
 
11
  Given a subset of EEG channels, ZUNA can:
12
+ - Denoise existing EEG channels
13
+ - Reconstruct missing EEG channels
14
+ - Predict novel channel signals given physical coordinates on the scalp
15
 
16
+ ZUNA was trained on approximately 2 million channel-hours of EEG data from a wide range of publicly available sources. All data used a standardized preprocessing pipeline to make it suitable for large-scale foundation model training.
 
 
17
 
18
+ At 380 million parameters, ZUNA is lightweight enough to run quickly on a consumer GPU and can be used on CPU for many workloads.
 
 
19
 
20
  // TODO channel reconstruction gif
21
 
22
 
23
  ## Performance
24
 
25
+ ZUNA significantly outperforms existing standard methods for channel denoising, reconstruction, or upsampling. We compared ZUNA to MNE's default spherical spline interpolation method which is ubiquitous in practice. We find that ZUNA outperforms MNE in reconstruction accuracy across a range of unseen datasets, even those with a different preprocessing pipeline. ZUNA’s advantage is particularly striking for higher upsampling ratios, demonstrating that ZUNA is effectively using general priors it has learned through large-scale pretraining.
26
 
27
  ![2x3_panel](https://cdn-uploads.huggingface.co/production/uploads/65c05e75c084467acab2f84a/zURH5s_AQvNhTDYY66_Yf.png)
28
 
 
60
 
61
  For more information please see our [technical whitepaper](arxiv) and [blog](blog). If you find ZUNA useful in your work please cite as
62
 
 
 
63
  Organizations or researchers interested in collaborating with Zyphra to improve future versions for specific needs or use cases should contact bci@zyphra.com.
64
 
65