New: ComfyUI Music Production Toolkit, end-to-end music production for YuE2 and YuE2 cover

#7
by jplenio - opened

banner

For anyone experimenting with YuE2 in ComfyUI: I’ve integrated YuE2 and YuE2 Cover into my open-source Music Production Toolkit for ComfyUI.

The goal is to provide a complete end-to-end workflow around YuE2, rather than only the generation step.

It supports normal YuE2 song generation as well as YuE2 Cover with:

  • Instrumental covers
  • Covers with original lyrics
  • Covers with new lyrics
  • Automatic preparation and analysis of the source audio for Cover mode
  • Control over how closely the new version should follow the original
  • LLM-assisted music prompts, arrangement and lyrics
  • Automatic model recommendations based on the available system hardware, helping users choose suitable models for their GPU/VRAM configuration
  • Optional audio restoration, EQ and mastering
  • FLAC/MP3 export with metadata
  • Optional cover artwork generation
  • Support for local and cloud-based LLMs

For normal YuE2 generation, you can start with a simple description of the music you want and let the workflow handle the remaining production steps.

For YuE2 Cover, you select a source audio file and the workflow handles the required preparation and intermediate steps automatically. The interpretation can also be adjusted from a relatively faithful cover to a much freer reinterpretation.

The toolkit also tries to make setup easier on different hardware configurations by recommending appropriate model variants based on the detected system resources. This should be especially useful for users with limited VRAM who are not sure which YuE2 configuration to start with.

YuE2, YuE2 Cover, LLM processing and post-production are integrated into one main ComfyUI workflow, while individual stages can still be enabled or disabled depending on what you need.

Repository and documentation:
https://github.com/jplenio/ComfyUI-MiniMax-Music-Production-Toolkit#readme

I’m the author of the toolkit, so feedback from other YuE2 users would be very welcome, particularly around Cover mode, model selection and different GPU configurations.

screenshot-main-workflow
screenshot-audio-enhancement

Sign up or log in to comment