You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

hyeyeon

DAC 16 kHz models (descript-audio-codec, commit c7cfc5d, source unmodified) retrained from scratch on speaker subsets of LibriSpeech train-clean-360.

Contents

Two sets of eight models, p1 and p2, with the same layout.

p1 p2
speakers per model 57 (of 114) 342-345 (of 688)
audio per model about 13 hours 76-79 hours
split seed 20261105 20261106

<set>/<model>/<checkpoint>/{dac,discriminator}/weights.pth

  • models: ref_00 ... ref_05, target_00, target_01 (each trained on a different speaker subset)
  • checkpoints: 50k, 100k, 200k, latest (= 250k steps)

<set>/splits/ (which audio each model was trained on)

  • models.csv: model names and roles
  • speakers.csv: speakers with sex, minutes, chapters, role (pool or population) and held-out chapter
  • membership_speaker.csv: 1 if a speaker's audio was in that model's training set
  • membership_utt.csv: the same per utterance
  • train_<model>.csv: the exact training file list of each model
  • eval_set.csv: the shared evaluation utterances (group: candidate, holdout, population)
  • manifest.json: split parameters and seed
  • Paths are from the original machine; replace the LibriSpeech root with your own.

<set>/configs/<model>.yml: the training config of each model (argbind format, for scripts/train.py)

Training

  • 250k steps, batch 12, train crop 0.3795 s, otherwise the official 16 kHz recipe
  • One NVIDIA B200, four models at a time, about 26 hours each

Quality (dev-clean, 500 files, 12 codebooks, latest)

  • p1: STOI 0.968-0.970, PESQ-WB 3.64-3.73, mel L1 0.430-0.447
  • p2: STOI 0.970-0.971, PESQ-WB 3.76-3.79, mel L1 0.424-0.432

Official 16 kHz model on the same files: STOI 0.973, PESQ-WB 4.00, mel L1 0.364.

Loading

import dac
model = dac.DAC.load("p1/ref_00/latest/dac/weights.pth")
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train Snooow1029/hyeyeon