How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="TuKoResearch/AuriStream100M_80Pred_BigAudioDataset_500k-randinit", trust_remote_code=True)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("TuKoResearch/AuriStream100M_80Pred_BigAudioDataset_500k-randinit", trust_remote_code=True, device_map="auto")
Quick Links

AuriStream100M_80Pred_BigAudioDataset_500k-randinit

AuriStream is a speech language model by Greta Tuckute and Klemen Kotar.

This model predicts cochlear tokens from a tokenizer such as WavCochCausalV8192.

Native training step-zero initialization for the 100M 80-prediction model. This exactly uses origin seed 11101994 and historical source commit 6b68c1b639726a9d82b76539d5e769a7fe7e29b9, matching the start of W&B run 2zdi8htl. The weights are untrained FP32 values produced before XLA/FSDP wrapping.

Model Details

Parameter Value
Parameters ~0.59B
Layers 12
Hidden Size 768
Attention Heads 12
Vocab Size 8192
Prediction Steps 80

Usage

from transformers import AutoModel, AutoConfig

# Load with trust_remote_code for custom model
model = AutoModel.from_pretrained(
    "TuKoResearch/AuriStream100M_80Pred_BigAudioDataset_500k-randinit",
    trust_remote_code=True,
)

# Or load config first
config = AutoConfig.from_pretrained("TuKoResearch/AuriStream100M_80Pred_BigAudioDataset_500k-randinit", trust_remote_code=True)

Base Model Code

This checkpoint uses shared model code from TuKoResearch/AuriStream-base.

Tokenizer

This model uses cochlear tokens from WavCochCausalV8192.

Downloads last month
8
Safetensors
Model size
0.6B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support