init
Browse files
README.md
CHANGED
|
@@ -48,9 +48,7 @@ The unified model supports **text-to-speech**, **note-conditioned singing**, and
|
|
| 48 |
|
| 49 |
## Installation
|
| 50 |
|
| 51 |
-
Use **Python 3.10
|
| 52 |
-
CUDA inference is recommended; BigVGAN uses standard PyTorch operations and
|
| 53 |
-
does not require custom CUDA extensions.
|
| 54 |
|
| 55 |
```bash
|
| 56 |
conda create -n sembridge python=3.10 -y
|
|
@@ -65,11 +63,6 @@ python -m pip install torch==2.6.0 torchaudio==2.6.0 \
|
|
| 65 |
python -m pip install -e .
|
| 66 |
```
|
| 67 |
|
| 68 |
-
For other CUDA versions or CPU-only installation, use the
|
| 69 |
-
[official PyTorch installation commands](https://pytorch.org/get-started/previous-versions/).
|
| 70 |
-
Keep the `torch` and `torchaudio` versions matched. Run the examples below from
|
| 71 |
-
the repository root.
|
| 72 |
-
|
| 73 |
## Inference
|
| 74 |
|
| 75 |
```python
|
|
@@ -78,10 +71,10 @@ from sembridge.requests import load_request
|
|
| 78 |
|
| 79 |
# Automatically download and load the checkpoint.
|
| 80 |
model = SemBridge.from_pretrained(
|
| 81 |
-
"ASLP-lab/SemBridge", device="cuda", dtype="bfloat16"
|
| 82 |
)
|
| 83 |
-
model.
|
| 84 |
-
"outputs/singing.wav",
|
| 85 |
**load_request("examples/svs/zh_r001.json"),
|
| 86 |
)
|
| 87 |
```
|
|
@@ -117,23 +110,23 @@ Audio is saved to `outputs/examples/<example_id>.wav`. Set `MODEL=/path/to/SemBr
|
|
| 117 |
to use local weights. See the **[example catalog](https://github.com/ASLP-lab/SemBridge/blob/main/examples/README.md)** for the
|
| 118 |
complete list, reference recordings, and guidance on using your own songs.
|
| 119 |
|
| 120 |
-
### Single
|
| 121 |
|
| 122 |
```bash
|
| 123 |
# Text-to-speech
|
| 124 |
sembridge-infer --model ASLP-lab/SemBridge --task tts \
|
| 125 |
--input examples/tts/zh_r001.json --output outputs/tts.wav \
|
| 126 |
-
--device cuda --dtype bfloat16
|
| 127 |
|
| 128 |
# Singing voice synthesis
|
| 129 |
sembridge-infer --model ASLP-lab/SemBridge --task svs \
|
| 130 |
--input examples/svs/zh_r001.json --output outputs/svs.wav \
|
| 131 |
-
--device cuda --dtype bfloat16
|
| 132 |
|
| 133 |
# Mixed speech and singing
|
| 134 |
sembridge-infer --model ASLP-lab/SemBridge --task unified \
|
| 135 |
--input examples/unified/zh_novel_wukong.json --output outputs/unified.wav \
|
| 136 |
-
--device cuda --dtype bfloat16
|
| 137 |
```
|
| 138 |
|
| 139 |
Outputs are **mono, 44.1 kHz WAV**. `--decoder auto` uses the defaults above;
|
|
|
|
| 48 |
|
| 49 |
## Installation
|
| 50 |
|
| 51 |
+
Use **Python 3.10**.
|
|
|
|
|
|
|
| 52 |
|
| 53 |
```bash
|
| 54 |
conda create -n sembridge python=3.10 -y
|
|
|
|
| 63 |
python -m pip install -e .
|
| 64 |
```
|
| 65 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 66 |
## Inference
|
| 67 |
|
| 68 |
```python
|
|
|
|
| 71 |
|
| 72 |
# Automatically download and load the checkpoint.
|
| 73 |
model = SemBridge.from_pretrained(
|
| 74 |
+
"ASLP-lab/SemBridge", device="cuda:0", dtype="bfloat16"
|
| 75 |
)
|
| 76 |
+
model.generate(
|
| 77 |
+
output="outputs/singing.wav",
|
| 78 |
**load_request("examples/svs/zh_r001.json"),
|
| 79 |
)
|
| 80 |
```
|
|
|
|
| 110 |
to use local weights. See the **[example catalog](https://github.com/ASLP-lab/SemBridge/blob/main/examples/README.md)** for the
|
| 111 |
complete list, reference recordings, and guidance on using your own songs.
|
| 112 |
|
| 113 |
+
### Single-Sample Inference
|
| 114 |
|
| 115 |
```bash
|
| 116 |
# Text-to-speech
|
| 117 |
sembridge-infer --model ASLP-lab/SemBridge --task tts \
|
| 118 |
--input examples/tts/zh_r001.json --output outputs/tts.wav \
|
| 119 |
+
--device cuda:0 --dtype bfloat16
|
| 120 |
|
| 121 |
# Singing voice synthesis
|
| 122 |
sembridge-infer --model ASLP-lab/SemBridge --task svs \
|
| 123 |
--input examples/svs/zh_r001.json --output outputs/svs.wav \
|
| 124 |
+
--device cuda:0 --dtype bfloat16
|
| 125 |
|
| 126 |
# Mixed speech and singing
|
| 127 |
sembridge-infer --model ASLP-lab/SemBridge --task unified \
|
| 128 |
--input examples/unified/zh_novel_wukong.json --output outputs/unified.wav \
|
| 129 |
+
--device cuda:0 --dtype bfloat16
|
| 130 |
```
|
| 131 |
|
| 132 |
Outputs are **mono, 44.1 kHz WAV**. `--decoder auto` uses the defaults above;
|