Sync README from GitHub
Browse files
README.md
CHANGED
|
@@ -6,33 +6,30 @@ tags:
|
|
| 6 |
- audio-super-resolution
|
| 7 |
---
|
| 8 |
|
| 9 |
-
# CPR:
|
| 10 |
|
| 11 |
1. **Composer–Performer (CP)** takes prompt audio, prompt MIDI, and target MIDI,
|
| 12 |
-
and
|
| 13 |
-
Transformer; the Performer renders local Mel
|
| 14 |
-
A Vocos vocoder converts the generated Mel
|
| 15 |
2. **Refiner (R)** takes a **24 kHz audio file** and writes **48 kHz mono audio**
|
| 16 |
using the LavaSR-based bandwidth-extension model and low-frequency fusion.
|
| 17 |
|
| 18 |
## Installation
|
| 19 |
|
| 20 |
-
Create a
|
| 21 |
|
| 22 |
```bash
|
| 23 |
-
conda create -n cpr python=3.10
|
| 24 |
conda activate cpr
|
| 25 |
-
|
| 26 |
```
|
| 27 |
|
| 28 |
On the first CP run, CLAP automatically downloads and caches its RoBERTa initialization resources.
|
| 29 |
|
| 30 |
## Checkpoints
|
| 31 |
|
| 32 |
-
Download the inference assets from [
|
| 33 |
-
Run the following command from the code repository root with the `cpr` Conda environment activated.
|
| 34 |
-
|
| 35 |
-
Download the four files directly into `checkpoints/`:
|
| 36 |
|
| 37 |
```bash
|
| 38 |
hf download bruceL33/CPR \
|
|
@@ -65,9 +62,6 @@ curl --fail --location \
|
|
| 65 |
|
| 66 |
## Inference
|
| 67 |
|
| 68 |
-
Run commands from the repository root. The included [piano example](examples/piano/README.md)
|
| 69 |
-
contains three inputs: `prompt.wav`, `prompt.mid`, and `target.mid`.
|
| 70 |
-
|
| 71 |
### 1. Composer–Performer → 24 kHz
|
| 72 |
|
| 73 |
```bash
|
|
@@ -76,7 +70,7 @@ bash scripts/infer_cp.sh
|
|
| 76 |
|
| 77 |
### 2. Refiner → 48 kHz
|
| 78 |
|
| 79 |
-
use any existing 24 kHz WAV:
|
| 80 |
|
| 81 |
```bash
|
| 82 |
python infer_refiner.py --input /path/to/audio_24k.wav --output outputs/refined.wav
|
|
|
|
| 6 |
- audio-super-resolution
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# CPR: COMBINING GLOBAL COMPOSING, LOCAL PERFORMING AND FULL-SEQUENCE REFINING IN PIANO RENDERING WITH CONTINUOUS AUTOREGRESSIVE MODELLING
|
| 10 |
|
| 11 |
1. **Composer–Performer (CP)** takes prompt audio, prompt MIDI, and target MIDI,
|
| 12 |
+
and renders **24 kHz mono audio**. The Composer is an autoregressive Qwen3
|
| 13 |
+
Transformer; the Performer renders local Mel spectrograms with flow matching.
|
| 14 |
+
A Vocos vocoder converts the generated Mel spectrograms to audio.
|
| 15 |
2. **Refiner (R)** takes a **24 kHz audio file** and writes **48 kHz mono audio**
|
| 16 |
using the LavaSR-based bandwidth-extension model and low-frequency fusion.
|
| 17 |
|
| 18 |
## Installation
|
| 19 |
|
| 20 |
+
Create a Conda environment with Python 3.10:
|
| 21 |
|
| 22 |
```bash
|
| 23 |
+
conda create -n cpr python=3.10
|
| 24 |
conda activate cpr
|
| 25 |
+
pip install -r requirements.txt
|
| 26 |
```
|
| 27 |
|
| 28 |
On the first CP run, CLAP automatically downloads and caches its RoBERTa initialization resources.
|
| 29 |
|
| 30 |
## Checkpoints
|
| 31 |
|
| 32 |
+
Download the inference assets from [Huggingface](https://huggingface.co/FEAfeatherTHER/CPR) into `checkpoints/`.
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
```bash
|
| 35 |
hf download bruceL33/CPR \
|
|
|
|
| 62 |
|
| 63 |
## Inference
|
| 64 |
|
|
|
|
|
|
|
|
|
|
| 65 |
### 1. Composer–Performer → 24 kHz
|
| 66 |
|
| 67 |
```bash
|
|
|
|
| 70 |
|
| 71 |
### 2. Refiner → 48 kHz
|
| 72 |
|
| 73 |
+
use any existing 24 kHz WAV or the output of Composer-Performer:
|
| 74 |
|
| 75 |
```bash
|
| 76 |
python infer_refiner.py --input /path/to/audio_24k.wav --output outputs/refined.wav
|