Document unified EchoLoc code and checkpoints repository
Browse files- CHECKPOINTS.md +24 -0
- MANIFEST.tsv +2 -1
- README.md +13 -4
CHECKPOINTS.md
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Released Checkpoints
|
| 2 |
+
|
| 3 |
+
The checkpoints below are the model artifacts used for the reported best EchoLoc Thinker+Talker evaluation. They are stored in this repository under `checkpoints/` and are separate from the source-only `MANIFEST.tsv`.
|
| 4 |
+
|
| 5 |
+
## Thinker
|
| 6 |
+
|
| 7 |
+
- Repository path: `checkpoints/thinker/`
|
| 8 |
+
- Training artifact: Iter006 `latest_final_model`
|
| 9 |
+
- Format: PEFT LoRA adapter with tokenizer and processor assets
|
| 10 |
+
- Base model: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
|
| 11 |
+
- Main file: `adapter_model.safetensors`
|
| 12 |
+
- Size: `4,642,233,208` bytes
|
| 13 |
+
- SHA-256: `cf716ae5bb40a49ef75f642229a0e7ca74e381925e21c66f8d161aa128514ac2`
|
| 14 |
+
|
| 15 |
+
## Talker
|
| 16 |
+
|
| 17 |
+
- Repository path: `checkpoints/talker/`
|
| 18 |
+
- Training artifact: `qwen3omni_talker_vstyle_46000`
|
| 19 |
+
- Format: Talker state dictionary with tokenizer assets
|
| 20 |
+
- Main file: `pytorch_model.bin`
|
| 21 |
+
- Size: `3,833,490,035` bytes
|
| 22 |
+
- SHA-256: `cd1e07334a94b59f827f55c6805b80a3ac8e0ed9b9c92217590ede712783b335`
|
| 23 |
+
|
| 24 |
+
The Talker loader first initializes the merged Qwen3-TTS Base/VoiceDesign origin and then loads this state dictionary into the inner Talker. See `checkpoints/talker/README.md` and `RUNBOOK.md` for the exact commands.
|
MANIFEST.tsv
CHANGED
|
@@ -12,6 +12,7 @@ calibration_agent/supervisor/settings.py 5459 66dea00fe354a21acd5e070e4af8e04777
|
|
| 12 |
calibration_agent/supervisor/simple_agent.py 69263 0331facf2bbc4d0621f9bbee4f9ec13a14411ca0756d75ced33b3dd02989f712
|
| 13 |
calibration_agent/supervisor/store.py 1241 8cdaa0ab421d49f67ec28846ee92de0a840a238cb9782029d2ab123c03a3754a
|
| 14 |
calibration_agent/supervisor/ui.py 27801 2dc34cda0deb6ba99442ccce825fa9bace466f86f386406844e8033fd6d44490
|
|
|
|
| 15 |
data_construction/add_iter006_english_prompts.py 20797 8f88f28f019a491abdf432eca6ee4387219c88328f3556ae0a26dc95db50b62d
|
| 16 |
data_construction/audit_wav_clipping.py 2086 51f66c9466d4738ae300a0b652a48ac673e82ace13539119e34b65c217036653
|
| 17 |
data_construction/build_thinker_sft_data.py 7898 7245fbd8b65c449b0b9c96247cb86ac3384d1a0e9faa8891cc19b3e0b883b8b6
|
|
@@ -227,7 +228,7 @@ model/thinker_talker/examples/qwen3omni_thinker/train_simple.sh 992 5ae961f75df2
|
|
| 227 |
model/thinker_talker/models/qwen3_tts/core/models/modeling_qwen3_tts.py 152204 4aa5583b4cce5d8ee54069474424cbf26fc4acca7d977fb36e14324efa18b83a
|
| 228 |
model/thinker_talker/models/qwen3_tts/inference/qwen3_tts_model.py 42661 96b16a4a7a855d32322310fa721e6fa3dd0ee755e049f6511db91b149c64d21f
|
| 229 |
model/thinker_talker/models/qwen3omni/model.py 14892 38f2ca200ae0361708584522a63e0043eb135d472720d69197f8f99d0c00ee8e
|
| 230 |
-
README.md
|
| 231 |
rendering/universal_tts/configs/cosyvoice2.yaml 3507 895db6dc291c1ca2c4e3bb0327097e84f447eb6d68063403ea20200dc7efd0df
|
| 232 |
rendering/universal_tts/configs/defaults.yaml 920 1224660c8c09d3c9a09ac4555845c18040acf9f108fb318dd64c848c9a8ba21f
|
| 233 |
rendering/universal_tts/configs/ds_zero2.json 533 3f5cf0247bc119d502aa487f0d27186fd24bfa3b02dfc3834c2ec4b53772ccf8
|
|
|
|
| 12 |
calibration_agent/supervisor/simple_agent.py 69263 0331facf2bbc4d0621f9bbee4f9ec13a14411ca0756d75ced33b3dd02989f712
|
| 13 |
calibration_agent/supervisor/store.py 1241 8cdaa0ab421d49f67ec28846ee92de0a840a238cb9782029d2ab123c03a3754a
|
| 14 |
calibration_agent/supervisor/ui.py 27801 2dc34cda0deb6ba99442ccce825fa9bace466f86f386406844e8033fd6d44490
|
| 15 |
+
CHECKPOINTS.md 1130 d2e2ff26797795c176963814db732f057a03573e8392821d0f54dfcd8689b40e
|
| 16 |
data_construction/add_iter006_english_prompts.py 20797 8f88f28f019a491abdf432eca6ee4387219c88328f3556ae0a26dc95db50b62d
|
| 17 |
data_construction/audit_wav_clipping.py 2086 51f66c9466d4738ae300a0b652a48ac673e82ace13539119e34b65c217036653
|
| 18 |
data_construction/build_thinker_sft_data.py 7898 7245fbd8b65c449b0b9c96247cb86ac3384d1a0e9faa8891cc19b3e0b883b8b6
|
|
|
|
| 228 |
model/thinker_talker/models/qwen3_tts/core/models/modeling_qwen3_tts.py 152204 4aa5583b4cce5d8ee54069474424cbf26fc4acca7d977fb36e14324efa18b83a
|
| 229 |
model/thinker_talker/models/qwen3_tts/inference/qwen3_tts_model.py 42661 96b16a4a7a855d32322310fa721e6fa3dd0ee755e049f6511db91b149c64d21f
|
| 230 |
model/thinker_talker/models/qwen3omni/model.py 14892 38f2ca200ae0361708584522a63e0043eb135d472720d69197f8f99d0c00ee8e
|
| 231 |
+
README.md 2635 df2f6d87f48c383b569707a1f951068c00177693c32e2f11d0b5d1f6212593e7
|
| 232 |
rendering/universal_tts/configs/cosyvoice2.yaml 3507 895db6dc291c1ca2c4e3bb0327097e84f447eb6d68063403ea20200dc7efd0df
|
| 233 |
rendering/universal_tts/configs/defaults.yaml 920 1224660c8c09d3c9a09ac4555845c18040acf9f108fb318dd64c848c9a8ba21f
|
| 234 |
rendering/universal_tts/configs/ds_zero2.json 533 3f5cf0247bc119d502aa487f0d27186fd24bfa3b02dfc3834c2ec4b53772ccf8
|
README.md
CHANGED
|
@@ -14,12 +14,18 @@ Large datasets, generated audio, cached features, job logs, API credentials, and
|
|
| 14 |
|
| 15 |
## Released checkpoints
|
| 16 |
|
| 17 |
-
- Thinker PEFT adapter: `
|
| 18 |
-
- Talker checkpoint: `
|
| 19 |
- Thinker base: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
|
| 20 |
- Talker origins: `Qwen/Qwen3-TTS-12Hz-1.7B-Base` and `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign`
|
| 21 |
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
## Directory map
|
| 25 |
|
|
@@ -32,7 +38,10 @@ The Talker checkpoint is loaded over the Base/VoiceDesign merged origin describe
|
|
| 32 |
- `evaluation/render_metrics/` and `evaluation/esd/`: AutoPCP, emotion embedding, smoothness, WER, ESD alignment, and report generation.
|
| 33 |
- `inference/benchmarks/`: generic benchmark input, Thinker/Talker inference, and output export.
|
| 34 |
- `experiments/`: reviewer-facing statistical analyses.
|
|
|
|
|
|
|
|
|
|
| 35 |
- `SOURCE_INVENTORY.tsv`: implementation-area inventory.
|
| 36 |
-
- `MANIFEST.tsv`: size and SHA-256 for every
|
| 37 |
|
| 38 |
Start with `ENVIRONMENT.md`, then follow `RUNBOOK.md`. Run `python tools/validate_archive.py` for a source and manifest integrity check.
|
|
|
|
| 14 |
|
| 15 |
## Released checkpoints
|
| 16 |
|
| 17 |
+
- Thinker PEFT adapter: `checkpoints/thinker/`
|
| 18 |
+
- Talker checkpoint: `checkpoints/talker/`
|
| 19 |
- Thinker base: `Qwen/Qwen3-Omni-30B-A3B-Instruct`
|
| 20 |
- Talker origins: `Qwen/Qwen3-TTS-12Hz-1.7B-Base` and `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign`
|
| 21 |
|
| 22 |
+
Download this private repository, including both checkpoints, with:
|
| 23 |
+
|
| 24 |
+
```bash
|
| 25 |
+
hf download zsy814/EchoLoc --local-dir echoloc-release
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
The Talker checkpoint is loaded over the Base/VoiceDesign merged origin described in `checkpoints/talker/README.md`. This repository is kept private during double-blind review and can be made public after anonymity restrictions are lifted.
|
| 29 |
|
| 30 |
## Directory map
|
| 31 |
|
|
|
|
| 38 |
- `evaluation/render_metrics/` and `evaluation/esd/`: AutoPCP, emotion embedding, smoothness, WER, ESD alignment, and report generation.
|
| 39 |
- `inference/benchmarks/`: generic benchmark input, Thinker/Talker inference, and output export.
|
| 40 |
- `experiments/`: reviewer-facing statistical analyses.
|
| 41 |
+
- `checkpoints/thinker/`: best Iter006 Thinker PEFT adapter and tokenizer assets.
|
| 42 |
+
- `checkpoints/talker/`: best Talker-46000 state dictionary and tokenizer assets.
|
| 43 |
+
- `CHECKPOINTS.md`: checkpoint provenance, byte sizes, and SHA-256 digests.
|
| 44 |
- `SOURCE_INVENTORY.tsv`: implementation-area inventory.
|
| 45 |
+
- `MANIFEST.tsv`: size and SHA-256 for every source-release file; checkpoint hashes are recorded separately in `CHECKPOINTS.md`.
|
| 46 |
|
| 47 |
Start with `ENVIRONMENT.md`, then follow `RUNBOOK.md`. Run `python tools/validate_archive.py` for a source and manifest integrity check.
|