Text-to-Audio
PyTorch
yue2
yue-2
yue2-music
yue2-music-generation
yue2-3b
yue2-comfyui
yue2-music-cover
yue2-text-to-music
yue
sheetsage2
sheetsage2-audio-encoder
comfy-org
ai-music
ai-music-generation
music-generation
text-to-music
lyrics-to-music
text-to-song
audio-generation
music-synthesis
generative-music
generative-audio
music-creation
ai-song-generator
ai-music-generator
song-generation
full-song-generation
complete-song-generation
vocal-generation
ai-vocals
singing-synthesis
ai-singing
singing-voice-generation
vocal-synthesis
synthetic-vocals
music-with-vocals
vocals-and-instruments
instrumental-generation
instrumental-music
melody-generation
melody-synthesis
chord-generation
chord-progression
music-composition
automatic-music-composition
ai-composer
songwriting
ai-songwriting
lyrics-generation
lyrics
lyric-conditioned-generation
music-cover
ai-music-cover
song-cover
vocal-cover
music-transformation
music-to-music
audio-to-audio
reference-audio
reference-based-generation
melody-conditioned-generation
melody-conditioning
melody-preservation
audio-encoder
audio-understanding
audio-feature-extraction
music-analysis
music-transcription
music-information-retrieval
abc-notation
abc-music-notation
abc-planning
musical-structure
music-arrangement
music-theory
bpm-control
tempo-control
genre-conditioning
style-conditioning
music-style-transfer
pop-music
electronic-music
hip-hop
rock-music
jazz
classical-music
diffusion
generative-model
foundation-model
deep-learning
machine-learning
artificial-intelligence
neural-networks
transformer
autoregressive-model
sequence-modeling
audio-model
music-model
3b-parameters
model-inference
inference
python
audio-processing
sound-generation
sound-design
waveform-generation
flac
wav
mp3
audio-export
comfyui
comfyui-workflow
comfyui-custom-nodes
comfyui-audio
comfyui-music-generation
comfyui-api
node-based-workflow
workflow
google-colab
colab-notebook
jupyter-notebook
google-colab-gpu
nvidia-t4
gpu-acceleration
cuda
cloud-gpu
ai-workflow
ai-tools
open-source-ai
music-generation-tool
music-generation-tutorial
audio-generation-tutorial
tutorial
beginner-friendly
no-code
low-code
interactive-ai
creative-ai
creative-workflow
machine-learning-project
ai-project
โก YuE2 Music Generation in Google Colab
This repository provides an easy-to-use Google Colab notebook to run YuE2, an advanced AI music generation model. Built on ComfyUI, this tool allows you to create complete songs with vocals from scratch (Text-to-Music) or generate customized covers of existing songs (Music Cover), all running locally on a free Google Colab T4 GPU.
๐ฅ Watch the Tutorial: How to Use
๐ Run in Colab: Open Google Colab Notebook
โจ Features Supported in this Notebook
This notebook streamlines the complex YuE2 music generation process into simple steps:
- โ๏ธ Initialize Core Environment: Automatically sets up the ComfyUI engine and essential dependencies for native YuE2 nodes.
- ๐ฅ Download YuE2 Models: Rapidly fetches the 3B parameter YuE2 checkpoint. It also includes an optional download for the SheetSage2 audio encoder, which is required if you want to create song covers.
- ๐ต YuE2 Text to Music:
- Generate a complete song (vocals and instruments) simply by providing a text description of the style (e.g., "contemporary pop, 96 BPM") and writing your own lyrics.
- Supports ABC Planning: The AI can write an editable melody/chord plan before rendering the audio for better musical structure.
- Control the max duration (up to 900 seconds) and generation mode (full song or melody only).
- ๐ค YuE2 Music Cover:
- Upload an existing
.flac,.wav, or.mp3song. - The SheetSage2 encoder transcribes the original melody, and YuE2 re-sings it using your newly provided lyrics and musical style!
- Upload an existing
๐ ๏ธ How to Use
- Click the "Open in Colab" badge above.
- Go to Runtime > Change runtime type and ensure the T4 GPU is selected in Colab.
- Run Cell 1 to initialize the ComfyUI environment.
- Run Cell 2 to download the models. Make sure
DOWNLOAD_SHEETSAGE2is checked if you want to make covers. - To generate a new song: Go to Cell 3, type your music style and lyrics (using tags like
[Verse]), and click Play. - To make a cover: Go to Cell 4, type your new style and lyrics, and click Play. You will be prompted to upload your reference song.
- Note: YuE2 is a large model. Song generation will take several minutes on a T4 GPU.
๐ค Credits
- Notebook Creator: @CoinNoin
- Base Models: Comfy-Org / YuE2