Text-to-Audio
PyTorch
yue2
yue-2
yue2-music
yue2-music-generation
yue2-3b
yue2-comfyui
yue2-music-cover
yue2-text-to-music
yue
sheetsage2
sheetsage2-audio-encoder
comfy-org
ai-music
ai-music-generation
music-generation
text-to-music
lyrics-to-music
text-to-song
audio-generation
music-synthesis
generative-music
generative-audio
music-creation
ai-song-generator
ai-music-generator
song-generation
full-song-generation
complete-song-generation
vocal-generation
ai-vocals
singing-synthesis
ai-singing
singing-voice-generation
vocal-synthesis
synthetic-vocals
music-with-vocals
vocals-and-instruments
instrumental-generation
instrumental-music
melody-generation
melody-synthesis
chord-generation
chord-progression
music-composition
automatic-music-composition
ai-composer
songwriting
ai-songwriting
lyrics-generation
lyrics
lyric-conditioned-generation
music-cover
ai-music-cover
song-cover
vocal-cover
music-transformation
music-to-music
audio-to-audio
reference-audio
reference-based-generation
melody-conditioned-generation
melody-conditioning
melody-preservation
audio-encoder
audio-understanding
audio-feature-extraction
music-analysis
music-transcription
music-information-retrieval
abc-notation
abc-music-notation
abc-planning
musical-structure
music-arrangement
music-theory
bpm-control
tempo-control
genre-conditioning
style-conditioning
music-style-transfer
pop-music
electronic-music
hip-hop
rock-music
jazz
classical-music
diffusion
generative-model
foundation-model
deep-learning
machine-learning
artificial-intelligence
neural-networks
transformer
autoregressive-model
sequence-modeling
audio-model
music-model
3b-parameters
model-inference
inference
python
audio-processing
sound-generation
sound-design
waveform-generation
flac
wav
mp3
audio-export
comfyui
comfyui-workflow
comfyui-custom-nodes
comfyui-audio
comfyui-music-generation
comfyui-api
node-based-workflow
workflow
google-colab
colab-notebook
jupyter-notebook
google-colab-gpu
nvidia-t4
gpu-acceleration
cuda
cloud-gpu
ai-workflow
ai-tools
open-source-ai
music-generation-tool
music-generation-tutorial
audio-generation-tutorial
tutorial
beginner-friendly
no-code
low-code
interactive-ai
creative-ai
creative-workflow
machine-learning-project
ai-project

โšก YuE2 Music Generation in Google Colab

This repository provides an easy-to-use Google Colab notebook to run YuE2, an advanced AI music generation model. Built on ComfyUI, this tool allows you to create complete songs with vocals from scratch (Text-to-Music) or generate customized covers of existing songs (Music Cover), all running locally on a free Google Colab T4 GPU.

๐ŸŽฅ Watch the Tutorial: How to Use

๐Ÿš€ Run in Colab: Open Google Colab Notebook

Open In Colab Get Pro


โœจ Features Supported in this Notebook

This notebook streamlines the complex YuE2 music generation process into simple steps:

  1. โš™๏ธ Initialize Core Environment: Automatically sets up the ComfyUI engine and essential dependencies for native YuE2 nodes.
  2. ๐Ÿ“ฅ Download YuE2 Models: Rapidly fetches the 3B parameter YuE2 checkpoint. It also includes an optional download for the SheetSage2 audio encoder, which is required if you want to create song covers.
  3. ๐ŸŽต YuE2 Text to Music:
    • Generate a complete song (vocals and instruments) simply by providing a text description of the style (e.g., "contemporary pop, 96 BPM") and writing your own lyrics.
    • Supports ABC Planning: The AI can write an editable melody/chord plan before rendering the audio for better musical structure.
    • Control the max duration (up to 900 seconds) and generation mode (full song or melody only).
  4. ๐ŸŽค YuE2 Music Cover:
    • Upload an existing .flac, .wav, or .mp3 song.
    • The SheetSage2 encoder transcribes the original melody, and YuE2 re-sings it using your newly provided lyrics and musical style!

๐Ÿ› ๏ธ How to Use

  1. Click the "Open in Colab" badge above.
  2. Go to Runtime > Change runtime type and ensure the T4 GPU is selected in Colab.
  3. Run Cell 1 to initialize the ComfyUI environment.
  4. Run Cell 2 to download the models. Make sure DOWNLOAD_SHEETSAGE2 is checked if you want to make covers.
  5. To generate a new song: Go to Cell 3, type your music style and lyrics (using tags like [Verse]), and click Play.
  6. To make a cover: Go to Cell 4, type your new style and lyrics, and click Play. You will be prompted to upload your reference song.
  7. Note: YuE2 is a large model. Song generation will take several minutes on a T4 GPU.

๐Ÿค Credits

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support