ASLP-lab commited on
Commit
b34d2dd
·
verified ·
1 Parent(s): 4fb6534
Files changed (1) hide show
  1. README.md +8 -15
README.md CHANGED
@@ -48,9 +48,7 @@ The unified model supports **text-to-speech**, **note-conditioned singing**, and
48
 
49
  ## Installation
50
 
51
- Use **Python 3.10+** and a matching **PyTorch / torchaudio 2.6-2.8** pair.
52
- CUDA inference is recommended; BigVGAN uses standard PyTorch operations and
53
- does not require custom CUDA extensions.
54
 
55
  ```bash
56
  conda create -n sembridge python=3.10 -y
@@ -65,11 +63,6 @@ python -m pip install torch==2.6.0 torchaudio==2.6.0 \
65
  python -m pip install -e .
66
  ```
67
 
68
- For other CUDA versions or CPU-only installation, use the
69
- [official PyTorch installation commands](https://pytorch.org/get-started/previous-versions/).
70
- Keep the `torch` and `torchaudio` versions matched. Run the examples below from
71
- the repository root.
72
-
73
  ## Inference
74
 
75
  ```python
@@ -78,10 +71,10 @@ from sembridge.requests import load_request
78
 
79
  # Automatically download and load the checkpoint.
80
  model = SemBridge.from_pretrained(
81
- "ASLP-lab/SemBridge", device="cuda", dtype="bfloat16"
82
  )
83
- model.generate_to_file(
84
- "outputs/singing.wav",
85
  **load_request("examples/svs/zh_r001.json"),
86
  )
87
  ```
@@ -117,23 +110,23 @@ Audio is saved to `outputs/examples/<example_id>.wav`. Set `MODEL=/path/to/SemBr
117
  to use local weights. See the **[example catalog](https://github.com/ASLP-lab/SemBridge/blob/main/examples/README.md)** for the
118
  complete list, reference recordings, and guidance on using your own songs.
119
 
120
- ### Single Request
121
 
122
  ```bash
123
  # Text-to-speech
124
  sembridge-infer --model ASLP-lab/SemBridge --task tts \
125
  --input examples/tts/zh_r001.json --output outputs/tts.wav \
126
- --device cuda --dtype bfloat16
127
 
128
  # Singing voice synthesis
129
  sembridge-infer --model ASLP-lab/SemBridge --task svs \
130
  --input examples/svs/zh_r001.json --output outputs/svs.wav \
131
- --device cuda --dtype bfloat16
132
 
133
  # Mixed speech and singing
134
  sembridge-infer --model ASLP-lab/SemBridge --task unified \
135
  --input examples/unified/zh_novel_wukong.json --output outputs/unified.wav \
136
- --device cuda --dtype bfloat16
137
  ```
138
 
139
  Outputs are **mono, 44.1 kHz WAV**. `--decoder auto` uses the defaults above;
 
48
 
49
  ## Installation
50
 
51
+ Use **Python 3.10**.
 
 
52
 
53
  ```bash
54
  conda create -n sembridge python=3.10 -y
 
63
  python -m pip install -e .
64
  ```
65
 
 
 
 
 
 
66
  ## Inference
67
 
68
  ```python
 
71
 
72
  # Automatically download and load the checkpoint.
73
  model = SemBridge.from_pretrained(
74
+ "ASLP-lab/SemBridge", device="cuda:0", dtype="bfloat16"
75
  )
76
+ model.generate(
77
+ output="outputs/singing.wav",
78
  **load_request("examples/svs/zh_r001.json"),
79
  )
80
  ```
 
110
  to use local weights. See the **[example catalog](https://github.com/ASLP-lab/SemBridge/blob/main/examples/README.md)** for the
111
  complete list, reference recordings, and guidance on using your own songs.
112
 
113
+ ### Single-Sample Inference
114
 
115
  ```bash
116
  # Text-to-speech
117
  sembridge-infer --model ASLP-lab/SemBridge --task tts \
118
  --input examples/tts/zh_r001.json --output outputs/tts.wav \
119
+ --device cuda:0 --dtype bfloat16
120
 
121
  # Singing voice synthesis
122
  sembridge-infer --model ASLP-lab/SemBridge --task svs \
123
  --input examples/svs/zh_r001.json --output outputs/svs.wav \
124
+ --device cuda:0 --dtype bfloat16
125
 
126
  # Mixed speech and singing
127
  sembridge-infer --model ASLP-lab/SemBridge --task unified \
128
  --input examples/unified/zh_novel_wukong.json --output outputs/unified.wav \
129
+ --device cuda:0 --dtype bfloat16
130
  ```
131
 
132
  Outputs are **mono, 44.1 kHz WAV**. `--decoder auto` uses the defaults above;