zsy814 commited on
Commit
a3e5563
·
verified ·
1 Parent(s): b0df408

Document unified EchoLoc code and checkpoints repository

Browse files
Files changed (3) hide show
  1. CHECKPOINTS.md +24 -0
  2. MANIFEST.tsv +2 -1
  3. README.md +13 -4
CHECKPOINTS.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Released Checkpoints
2
+
3
+ The checkpoints below are the model artifacts used for the reported best EchoLoc Thinker+Talker evaluation. They are stored in this repository under `checkpoints/` and are separate from the source-only `MANIFEST.tsv`.
4
+
5
+ ## Thinker
6
+
7
+ - Repository path: `checkpoints/thinker/`
8
+ - Training artifact: Iter006 `latest_final_model`
9
+ - Format: PEFT LoRA adapter with tokenizer and processor assets
10
+ - Base model: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
11
+ - Main file: `adapter_model.safetensors`
12
+ - Size: `4,642,233,208` bytes
13
+ - SHA-256: `cf716ae5bb40a49ef75f642229a0e7ca74e381925e21c66f8d161aa128514ac2`
14
+
15
+ ## Talker
16
+
17
+ - Repository path: `checkpoints/talker/`
18
+ - Training artifact: `qwen3omni_talker_vstyle_46000`
19
+ - Format: Talker state dictionary with tokenizer assets
20
+ - Main file: `pytorch_model.bin`
21
+ - Size: `3,833,490,035` bytes
22
+ - SHA-256: `cd1e07334a94b59f827f55c6805b80a3ac8e0ed9b9c92217590ede712783b335`
23
+
24
+ The Talker loader first initializes the merged Qwen3-TTS Base/VoiceDesign origin and then loads this state dictionary into the inner Talker. See `checkpoints/talker/README.md` and `RUNBOOK.md` for the exact commands.
MANIFEST.tsv CHANGED
@@ -12,6 +12,7 @@ calibration_agent/supervisor/settings.py 5459 66dea00fe354a21acd5e070e4af8e04777
12
  calibration_agent/supervisor/simple_agent.py 69263 0331facf2bbc4d0621f9bbee4f9ec13a14411ca0756d75ced33b3dd02989f712
13
  calibration_agent/supervisor/store.py 1241 8cdaa0ab421d49f67ec28846ee92de0a840a238cb9782029d2ab123c03a3754a
14
  calibration_agent/supervisor/ui.py 27801 2dc34cda0deb6ba99442ccce825fa9bace466f86f386406844e8033fd6d44490
 
15
  data_construction/add_iter006_english_prompts.py 20797 8f88f28f019a491abdf432eca6ee4387219c88328f3556ae0a26dc95db50b62d
16
  data_construction/audit_wav_clipping.py 2086 51f66c9466d4738ae300a0b652a48ac673e82ace13539119e34b65c217036653
17
  data_construction/build_thinker_sft_data.py 7898 7245fbd8b65c449b0b9c96247cb86ac3384d1a0e9faa8891cc19b3e0b883b8b6
@@ -227,7 +228,7 @@ model/thinker_talker/examples/qwen3omni_thinker/train_simple.sh 992 5ae961f75df2
227
  model/thinker_talker/models/qwen3_tts/core/models/modeling_qwen3_tts.py 152204 4aa5583b4cce5d8ee54069474424cbf26fc4acca7d977fb36e14324efa18b83a
228
  model/thinker_talker/models/qwen3_tts/inference/qwen3_tts_model.py 42661 96b16a4a7a855d32322310fa721e6fa3dd0ee755e049f6511db91b149c64d21f
229
  model/thinker_talker/models/qwen3omni/model.py 14892 38f2ca200ae0361708584522a63e0043eb135d472720d69197f8f99d0c00ee8e
230
- README.md 2186 c0481fe0bcd8ec95cf78471c64b5f523bfb3f321206874767be317dcdfe91860
231
  rendering/universal_tts/configs/cosyvoice2.yaml 3507 895db6dc291c1ca2c4e3bb0327097e84f447eb6d68063403ea20200dc7efd0df
232
  rendering/universal_tts/configs/defaults.yaml 920 1224660c8c09d3c9a09ac4555845c18040acf9f108fb318dd64c848c9a8ba21f
233
  rendering/universal_tts/configs/ds_zero2.json 533 3f5cf0247bc119d502aa487f0d27186fd24bfa3b02dfc3834c2ec4b53772ccf8
 
12
  calibration_agent/supervisor/simple_agent.py 69263 0331facf2bbc4d0621f9bbee4f9ec13a14411ca0756d75ced33b3dd02989f712
13
  calibration_agent/supervisor/store.py 1241 8cdaa0ab421d49f67ec28846ee92de0a840a238cb9782029d2ab123c03a3754a
14
  calibration_agent/supervisor/ui.py 27801 2dc34cda0deb6ba99442ccce825fa9bace466f86f386406844e8033fd6d44490
15
+ CHECKPOINTS.md 1130 d2e2ff26797795c176963814db732f057a03573e8392821d0f54dfcd8689b40e
16
  data_construction/add_iter006_english_prompts.py 20797 8f88f28f019a491abdf432eca6ee4387219c88328f3556ae0a26dc95db50b62d
17
  data_construction/audit_wav_clipping.py 2086 51f66c9466d4738ae300a0b652a48ac673e82ace13539119e34b65c217036653
18
  data_construction/build_thinker_sft_data.py 7898 7245fbd8b65c449b0b9c96247cb86ac3384d1a0e9faa8891cc19b3e0b883b8b6
 
228
  model/thinker_talker/models/qwen3_tts/core/models/modeling_qwen3_tts.py 152204 4aa5583b4cce5d8ee54069474424cbf26fc4acca7d977fb36e14324efa18b83a
229
  model/thinker_talker/models/qwen3_tts/inference/qwen3_tts_model.py 42661 96b16a4a7a855d32322310fa721e6fa3dd0ee755e049f6511db91b149c64d21f
230
  model/thinker_talker/models/qwen3omni/model.py 14892 38f2ca200ae0361708584522a63e0043eb135d472720d69197f8f99d0c00ee8e
231
+ README.md 2635 df2f6d87f48c383b569707a1f951068c00177693c32e2f11d0b5d1f6212593e7
232
  rendering/universal_tts/configs/cosyvoice2.yaml 3507 895db6dc291c1ca2c4e3bb0327097e84f447eb6d68063403ea20200dc7efd0df
233
  rendering/universal_tts/configs/defaults.yaml 920 1224660c8c09d3c9a09ac4555845c18040acf9f108fb318dd64c848c9a8ba21f
234
  rendering/universal_tts/configs/ds_zero2.json 533 3f5cf0247bc119d502aa487f0d27186fd24bfa3b02dfc3834c2ec4b53772ccf8
README.md CHANGED
@@ -14,12 +14,18 @@ Large datasets, generated audio, cached features, job logs, API credentials, and
14
 
15
  ## Released checkpoints
16
 
17
- - Thinker PEFT adapter: `zsy814/EchoLoc-Thinker`
18
- - Talker checkpoint: `zsy814/EchoLoc-Talker`
19
  - Thinker base: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
20
  - Talker origins: `Qwen/Qwen3-TTS-12Hz-1.7B-Base` and `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign`
21
 
22
- The Talker checkpoint is loaded over the Base/VoiceDesign merged origin described in the Talker model card. The repositories are kept private during double-blind review and can be made public after anonymity restrictions are lifted.
 
 
 
 
 
 
23
 
24
  ## Directory map
25
 
@@ -32,7 +38,10 @@ The Talker checkpoint is loaded over the Base/VoiceDesign merged origin describe
32
  - `evaluation/render_metrics/` and `evaluation/esd/`: AutoPCP, emotion embedding, smoothness, WER, ESD alignment, and report generation.
33
  - `inference/benchmarks/`: generic benchmark input, Thinker/Talker inference, and output export.
34
  - `experiments/`: reviewer-facing statistical analyses.
 
 
 
35
  - `SOURCE_INVENTORY.tsv`: implementation-area inventory.
36
- - `MANIFEST.tsv`: size and SHA-256 for every archived file.
37
 
38
  Start with `ENVIRONMENT.md`, then follow `RUNBOOK.md`. Run `python tools/validate_archive.py` for a source and manifest integrity check.
 
14
 
15
  ## Released checkpoints
16
 
17
+ - Thinker PEFT adapter: `checkpoints/thinker/`
18
+ - Talker checkpoint: `checkpoints/talker/`
19
  - Thinker base: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
20
  - Talker origins: `Qwen/Qwen3-TTS-12Hz-1.7B-Base` and `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign`
21
 
22
+ Download this private repository, including both checkpoints, with:
23
+
24
+ ```bash
25
+ hf download zsy814/EchoLoc --local-dir echoloc-release
26
+ ```
27
+
28
+ The Talker checkpoint is loaded over the Base/VoiceDesign merged origin described in `checkpoints/talker/README.md`. This repository is kept private during double-blind review and can be made public after anonymity restrictions are lifted.
29
 
30
  ## Directory map
31
 
 
38
  - `evaluation/render_metrics/` and `evaluation/esd/`: AutoPCP, emotion embedding, smoothness, WER, ESD alignment, and report generation.
39
  - `inference/benchmarks/`: generic benchmark input, Thinker/Talker inference, and output export.
40
  - `experiments/`: reviewer-facing statistical analyses.
41
+ - `checkpoints/thinker/`: best Iter006 Thinker PEFT adapter and tokenizer assets.
42
+ - `checkpoints/talker/`: best Talker-46000 state dictionary and tokenizer assets.
43
+ - `CHECKPOINTS.md`: checkpoint provenance, byte sizes, and SHA-256 digests.
44
  - `SOURCE_INVENTORY.tsv`: implementation-area inventory.
45
+ - `MANIFEST.tsv`: size and SHA-256 for every source-release file; checkpoint hashes are recorded separately in `CHECKPOINTS.md`.
46
 
47
  Start with `ENVIRONMENT.md`, then follow `RUNBOOK.md`. Run `python tools/validate_archive.py` for a source and manifest integrity check.