Instructions to use TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
AuriStream100M_10Pred_BigAudioDataset_500k-randinit
AuriStream is a speech language model by Greta Tuckute and Klemen Kotar.
This model predicts cochlear tokens from a tokenizer such as WavCochCausalV8192.
Untrained FP32 initialization for TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k, using seed 11101994 and the exact frozen source used by its training run. The native model was initialized on CPU in the trainer initialization order, before conversion to Hugging Face. This is step zero, not a trained 500k checkpoint. The old seed-1110 counterpart is TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k_seed1110-randinit.
Model Details
| Parameter | Value |
|---|---|
| Parameters | ~0.15B |
| Layers | 12 |
| Hidden Size | 768 |
| Attention Heads | 12 |
| Vocab Size | 8192 |
| Prediction Steps | 10 |
Usage
from transformers import AutoModel, AutoConfig
# Load with trust_remote_code for custom model
model = AutoModel.from_pretrained(
"TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit",
trust_remote_code=True,
)
# Or load config first
config = AutoConfig.from_pretrained("TuKoResearch/AuriStream100M_10Pred_BigAudioDataset_500k-randinit", trust_remote_code=True)
Base Model Code
This checkpoint uses shared model code from TuKoResearch/AuriStream-base.
Tokenizer
This model uses cochlear tokens from WavCochCausalV8192.
- Downloads last month
- -