Update README.md
Browse files
README.md
CHANGED
|
@@ -6,24 +6,23 @@ language:
|
|
| 6 |
|
| 7 |
# Model Card for ZUNA
|
| 8 |
|
| 9 |
-
ZUNA is a 380M-parameter masked diffusion autoencoder trained to reconstruct, denoise, and upsample scalp-EEG signals. ZUNA represents an early effort to build general foundation models of brain signals. Over time, we see these models forming the foundation
|
| 10 |
|
| 11 |
Given a subset of EEG channels, ZUNA can:
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
-
-
|
| 14 |
-
- Reconstruct missing channels
|
| 15 |
-
- Predict novel channel signals given the physical coordinates of electrodes on the scalp
|
| 16 |
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
At only 380M parameters, ZUNA can run comfortably on any consumer GPU or even on CPU.
|
| 20 |
|
| 21 |
// TODO channel reconstruction gif
|
| 22 |
|
| 23 |
|
| 24 |
## Performance
|
| 25 |
|
| 26 |
-
ZUNA significantly outperforms existing standard methods for channel denoising, reconstruction, or upsampling. We compared ZUNA to MNE's default spherical spline interpolation method which is ubiquitous in practice. We find that ZUNA outperforms MNE in reconstruction accuracy across a range of unseen datasets, even those with a different preprocessing pipeline.
|
| 27 |
|
| 28 |

|
| 29 |
|
|
@@ -61,8 +60,6 @@ python 3_tutorial_pt_to_fif.py
|
|
| 61 |
|
| 62 |
For more information please see our [technical whitepaper](arxiv) and [blog](blog). If you find ZUNA useful in your work please cite as
|
| 63 |
|
| 64 |
-
TODO citation.
|
| 65 |
-
|
| 66 |
Organizations or researchers interested in collaborating with Zyphra to improve future versions for specific needs or use cases should contact bci@zyphra.com.
|
| 67 |
|
| 68 |
|
|
|
|
| 6 |
|
| 7 |
# Model Card for ZUNA
|
| 8 |
|
| 9 |
+
ZUNA is a 380M-parameter masked diffusion autoencoder trained to reconstruct, denoise, and upsample scalp-EEG signals. ZUNA represents a significant milestone in the development of noninvasive thought-to-text and is an early effort to build general foundation models of brain signals that can be used to understand and decode brain states. Over time, we see these models forming the foundation of thought-to-text agentic systems and a key component in our mission to build human-aligned superintelligence.
|
| 10 |
|
| 11 |
Given a subset of EEG channels, ZUNA can:
|
| 12 |
+
- Denoise existing EEG channels
|
| 13 |
+
- Reconstruct missing EEG channels
|
| 14 |
+
- Predict novel channel signals given physical coordinates on the scalp
|
| 15 |
|
| 16 |
+
ZUNA was trained on approximately 2 million channel-hours of EEG data from a wide range of publicly available sources. All data used a standardized preprocessing pipeline to make it suitable for large-scale foundation model training.
|
|
|
|
|
|
|
| 17 |
|
| 18 |
+
At 380 million parameters, ZUNA is lightweight enough to run quickly on a consumer GPU and can be used on CPU for many workloads.
|
|
|
|
|
|
|
| 19 |
|
| 20 |
// TODO channel reconstruction gif
|
| 21 |
|
| 22 |
|
| 23 |
## Performance
|
| 24 |
|
| 25 |
+
ZUNA significantly outperforms existing standard methods for channel denoising, reconstruction, or upsampling. We compared ZUNA to MNE's default spherical spline interpolation method which is ubiquitous in practice. We find that ZUNA outperforms MNE in reconstruction accuracy across a range of unseen datasets, even those with a different preprocessing pipeline. ZUNA’s advantage is particularly striking for higher upsampling ratios, demonstrating that ZUNA is effectively using general priors it has learned through large-scale pretraining.
|
| 26 |
|
| 27 |

|
| 28 |
|
|
|
|
| 60 |
|
| 61 |
For more information please see our [technical whitepaper](arxiv) and [blog](blog). If you find ZUNA useful in your work please cite as
|
| 62 |
|
|
|
|
|
|
|
| 63 |
Organizations or researchers interested in collaborating with Zyphra to improve future versions for specific needs or use cases should contact bci@zyphra.com.
|
| 64 |
|
| 65 |
|