Audio-to-Audio
MambaSSM
Safetensors
speech-enhancement
universal speech enhancement
multiple input sampling rates
language-agnostic
Instructions to use nvidia/RE-USE with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MambaSSM
How to use nvidia/RE-USE with MambaSSM:
from mamba_ssm import MambaLMHeadModel model = MambaLMHeadModel.from_pretrained("nvidia/RE-USE") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,31 +24,34 @@ Directly try our [Gradio Demo]!!
|
|
| 24 |
|
| 25 |
## Environment
|
| 26 |
Pre-built Docker environments can be downloaded [here](https://github.com/RoyChao19477/SEMamba?tab=readme-ov-file#-docker-support) to simplify setup.
|
|
|
|
| 27 |
```bash
|
| 28 |
-
pip install resampy
|
| 29 |
```
|
| 30 |
## Inference
|
| 31 |
Follow the steps below to generate enhanced speech using our model:
|
| 32 |
-
1. Place your noisy speech files in the folder noisy_audio/
|
| 33 |
-
2. Put the corresponding model checkpoint in the folder exp/ (please align the path with the one used in the script)
|
| 34 |
3. Run the following command:
|
| 35 |
```bash
|
| 36 |
sh inference.sh
|
| 37 |
```
|
| 38 |
-
4. The enhanced speech files will be saved in enhanced_audio/.
|
|
|
|
|
|
|
| 39 |
|
| 40 |
**Note:**
|
| 41 |
|
| 42 |
-
a. You can enable or disable bandwidth extension by setting the target bandwidth using the `
|
| 43 |
|
| 44 |
If your noisy speech files are long and may cause GPU out-of-memory (OOM) errors, please use the following procedure instead:
|
| 45 |
-
1. Place your long noisy speech files in the folder long_noisy_audio/
|
| 46 |
-
2. Put the corresponding model checkpoint in the folder exp/ (please align the path with the one used in the script)
|
| 47 |
3. Run the following command:
|
| 48 |
```bash
|
| 49 |
sh inference_chunk_wise.sh
|
| 50 |
```
|
| 51 |
-
4. The enhanced speech files will be saved in Long_enhanced_audio/.
|
| 52 |
|
| 53 |
**Note:**
|
| 54 |
|
|
|
|
| 24 |
|
| 25 |
## Environment
|
| 26 |
Pre-built Docker environments can be downloaded [here](https://github.com/RoyChao19477/SEMamba?tab=readme-ov-file#-docker-support) to simplify setup.
|
| 27 |
+
If you need bandwidth extension:
|
| 28 |
```bash
|
| 29 |
+
pip install resampy
|
| 30 |
```
|
| 31 |
## Inference
|
| 32 |
Follow the steps below to generate enhanced speech using our model:
|
| 33 |
+
1. Place your noisy speech files in the folder `noisy_audio/`
|
| 34 |
+
2. Put the corresponding model checkpoint in the folder `exp/` (please align the path with the one used in the script)
|
| 35 |
3. Run the following command:
|
| 36 |
```bash
|
| 37 |
sh inference.sh
|
| 38 |
```
|
| 39 |
+
4. The enhanced speech files will be saved in `enhanced_audio/`.
|
| 40 |
+
|
| 41 |
+
---
|
| 42 |
|
| 43 |
**Note:**
|
| 44 |
|
| 45 |
+
a. You can enable or disable bandwidth extension by setting the target bandwidth using the `BWE argument` in the script.
|
| 46 |
|
| 47 |
If your noisy speech files are long and may cause GPU out-of-memory (OOM) errors, please use the following procedure instead:
|
| 48 |
+
1. Place your long noisy speech files in the folder `long_noisy_audio/`
|
| 49 |
+
2. Put the corresponding model checkpoint in the folder `exp/` (please align the path with the one used in the script)
|
| 50 |
3. Run the following command:
|
| 51 |
```bash
|
| 52 |
sh inference_chunk_wise.sh
|
| 53 |
```
|
| 54 |
+
4. The enhanced speech files will be saved in `Long_enhanced_audio/`.
|
| 55 |
|
| 56 |
**Note:**
|
| 57 |
|