| --- |
| license: apache-2.0 |
| --- |
| |
| ## 👉🏻 WenetSpeech-Chuan 👈🏻 |
|
|
| ## Highlight🔥 |
|
|
| **WenetSpeech-Chuan TTS Models** have been released! |
|
|
|
|
| ## Install |
|
|
| **Clone and install** |
|
|
| - Clone the repo |
| ``` sh |
| git clone https://github.com/ASLP-lab/WenetSpeech-Chuan.git |
| cd WenetSpeech-Chuan/CosyVoice2-Chuan |
| ``` |
|
|
| - Create Conda env: |
|
|
| ``` sh |
| conda create -n cosyvoice python=3.10 |
| conda activate cosyvoice |
| # pynini is required by WeTextProcessing, use conda to install it as it can be executed on all platform. |
| conda install -y -c conda-forge pynini==2.1.5 |
| pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host=mirrors.aliyun.com |
| |
| ``` |
|
|
| **Model download** |
|
|
| ``` python |
| from huggingface_hub import snapshot_download |
| snapshot_download('ASLP-lab/Cosyvoice2-Chuan', local_dir='pretrained_models/Cosyvoice2-Chuan') |
| |
| |
| ``` |
|
|
| **Usage** |
|
|
|
|
| ``` python |
| import sys |
| sys.path.append('third_party/Matcha-TTS') |
| from cosyvoice.cli.cosyvoice import CosyVoice, CosyVoice2 |
| from cosyvoice.utils.file_utils import load_wav |
| import torchaudio |
| import opencc |
| |
| cosyvoice_base = CosyVoice2( |
| 'pretrained_models/Cosyvoice2-Chuan', |
| load_jit=False, load_trt=False, load_vllm=False, fp16=False |
| ) |
| |
| |
| prompt_speech_16k = load_wav('asset/sg_017_090.wav', 16000) |
| |
| text = '我跟你说,四川火锅必须吃牛油锅底,而且必须蘸油碟,你知道了吗?' |
| |
| for i, j in enumerate(cosyvoice_base.inference_instruct2(text, '用四川话说这句话', prompt_speech_16k, stream=False)): |
| torchaudio.save('base_{}.wav'.format(i), j['tts_speech'], cosyvoice.sample_rate) |
| |
| |
| |
| ## Contact |
| If you are interested in leaving a message to our research team, feel free to email ziyu_zhang@mail.nwpu.edu.cn. |