nzxyin commited on
Commit
f318a3f
·
verified ·
1 Parent(s): 9c29116

Replace checkpoint with the Interspeech 2026 paper checkpoint (step 32000); add model card

Browse files

main previously served the 100k-step run, which does not match the paper. That model is kept at tag step-100k.

Files changed (2) hide show
  1. README.md +69 -0
  2. checkpoint.ckpt +2 -2
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - text-to-articulation
5
+ - articulatory-kinematics
6
+ - speech-synthesis
7
+ - sparc
8
+ language:
9
+ - en
10
+ datasets:
11
+ - mythicinfinity/libritts_r
12
+ ---
13
+
14
+ # STArK (large) — Interspeech 2026 paper checkpoint
15
+
16
+ This is the checkpoint used for the results reported in
17
+ **STArK: Towards Synthesizing Articulatory Kinematics from Text** (Xavier Yin, Carlos Busso,
18
+ Interspeech 2026).
19
+
20
+ - Code: https://github.com/Lab-MSP/STArK
21
+ - Paper (temporary link): https://lab-msp.com/MSP/publications/Yin_2026.pdf
22
+ - Project page: https://lab-msp.github.io/STArK/
23
+
24
+ ## Which checkpoint is this?
25
+
26
+ | File / revision | Training step | Notes |
27
+ |---|---|---|
28
+ | `checkpoint.ckpt` on `main` (tag `paper-step-32k`) | 32,000 | **Paper checkpoint.** `model=large_model train=train_large`, LibriTTS-R `train-clean-100`. |
29
+ | `checkpoint.ckpt` at tag `step-100k` | 100,000 | Longer, separate training run. Published here from 2026-08-23 to 2026-11-05. It does **not** match the paper's reported results. |
30
+
31
+ `main` served the 100k-step checkpoint until 2026-11-05. If you downloaded this model before
32
+ that date, you have the 100k-step model, not the paper model. Re-download to get the paper
33
+ checkpoint.
34
+
35
+ SHA-256 of the paper checkpoint (`checkpoint.ckpt` on `main`):
36
+ `1a704e045295e90c182001543b7fe0e2cb1fcb6fc9519a932e2bcb2da2dac5f3`
37
+
38
+ ## Usage
39
+
40
+ ```bash
41
+ git clone https://github.com/Lab-MSP/STArK && cd STArK && uv sync
42
+ python scripts/stark_cli.py synthesize "Hello, this is a test." \
43
+ --reference-audio my_voice.wav --output out.wav
44
+ ```
45
+
46
+ The CLI downloads `checkpoint.ckpt` from this repo's `main` branch by default.
47
+
48
+ To load the 100k-step run instead:
49
+
50
+ ```python
51
+ from huggingface_hub import hf_hub_download
52
+ path = hf_hub_download("Lab-MSP/stark-large", "checkpoint.ckpt", revision="step-100k")
53
+ ```
54
+
55
+ Then pass `--checkpoint <path>` to `stark_cli.py`.
56
+
57
+ ## Citation
58
+
59
+ ```bibtex
60
+ @inproceedings{yin2026stark,
61
+ title = {{STArK}: Towards Synthesizing Articulatory Kinematics from Text},
62
+ author = {Yin, Xavier and Busso, Carlos},
63
+ booktitle = {Proc. Interspeech 2026},
64
+ year = {2026}
65
+ }
66
+ ```
67
+
68
+ STArK resynthesizes speech with the SPARC vocoder; please also cite SPARC
69
+ (Cho et al., "Coding Speech through Vocal Tract Kinematics", IEEE JSTSP 2024).
checkpoint.ckpt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:862520ba77b8a38ac6f312dc6f631cd647e1b95f19f3bebd6e6f96ca59661c25
3
- size 884602956
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a704e045295e90c182001543b7fe0e2cb1fcb6fc9519a932e2bcb2da2dac5f3
3
+ size 884606086