magpietts-multi-357m-unicode

A Magpie TTS model by NVIDIA, from nvidia/magpie_tts_multilingual_357m, packaged for phoonnx, our ONNX text-to-speech library.

Model details

Architecture Magpie TTS
Upstream nvidia/magpie_tts_multilingual_357m
Author NVIDIA
Languages ar, fr, it, ko, vi
Text input Unicode codepoints of the text

How to use

pip install --pre phoonnx
import wave
from phoonnx.model_manager import TTSModelManager

manager = TTSModelManager()
manager.load()
manager.merge_default_voices()

voice = manager.voices["magpie/Aria/ar"].load()

with wave.open("output.wav", "wb") as wav_file:
    text = "..."  # a sentence in ar
    voice.synthesize_wav(text, wav_file)

In OVOS, phoonnx installs the ovos-tts-plugin-phoonnx plugin. Select the voice in mycroft.conf:

{"tts": {"module": "ovos-tts-plugin-phoonnx", "ovos-tts-plugin-phoonnx": {"voice": "magpie/Aria/ar"}}}

Text front end

phoonnx hands the text to scriptconv, our text conversion library, which normalises it and turns it into the model's input:

  • unicode: UnicodeCodepointPhonemizer from scriptconv.phonemizers.base, in scriptconv itself.

phoonnx voices

  • magpie/Aria/ar
  • magpie/Aria/fr
  • magpie/Aria/it
  • magpie/Aria/ko
  • magpie/Aria/vi
  • magpie/Jason/ar
  • magpie/Jason/fr
  • magpie/Jason/it
  • magpie/Jason/ko
  • magpie/Jason/vi
  • magpie/John/ar
  • magpie/John/fr
  • magpie/John/it
  • magpie/John/ko
  • magpie/John/vi
  • magpie/Leo/ar
  • magpie/Leo/fr
  • magpie/Leo/it
  • magpie/Leo/ko
  • magpie/Leo/vi
  • magpie/Sofia/ar
  • magpie/Sofia/fr
  • magpie/Sofia/it
  • magpie/Sofia/ko
  • magpie/Sofia/vi

Licence

The upstream declares the licence other (nvidia-open-model-license) in the model card of nvidia/magpie_tts_multilingual_357m.

Related projects

  • phoonnx: runs this model, in Python and in OVOS.
  • scriptconv: text normalisation, script conversion and phonemizers for phoonnx.
  • The Magpie TTS collection: every Magpie TTS model packaged for phoonnx.
Downloads last month
779
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including Phoonnx/magpietts-multi-357m-unicode