YuE - UI

Welcome to YuE - UI, an interface for the YuE music generation model.
The focus is on creativity, with an incremental song generation workflow using batch, select and continue.
Low VRAM 6-8 GB is supported as well!

The project uses YuE-exllamav2 for music generation sgsdxzy/YuE-exllamav2.
The interface was started from alisson-anjos/YuE-Interface.
The official YuE repo can be found here multimodal-art-projection/YuE

Features

• Batch, select & continue
• Rewind
• Choose whether to generate Stage 1, 2, 1+2 or preview cache
• Visualize generated song segments
• Control song segment token distribution
• Mute selected segments to steer generation process and save VRAM
• Load & save

UI preview

Installation

Windows:

git clone https://github.com/joeljuvel/YuE-UI/
cd YuE-UI
git clone https://huggingface.co/m-a-p/xcodec_mini_infer
python -m venv venv
./venv/scripts/activate
pip install -r requirements.txt

Linux:

git clone https://github.com/joeljuvel/YuE-UI/
cd YuE-UI
git clone https://huggingface.co/m-a-p/xcodec_mini_infer
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt

Running

Place your YuE exl2 models in the models/ folder.

Windows:
Run start_windows.bat to start the gradio server

Linux:
Run ./start_linux.sh to start the gradio server

After starting the gradio server open http://127.0.0.1:7860 in your browser to access the UI.

Tips & trick

Switch between models e.g. you can use the ICL model with an audio prompt to generate one section, then disable the audio prompt and switch to another model.
On the stage 1 settings tab you have several familiar control options e.g. CFG.

You can modify the start and stop time of segments in the timeline view. Optionally you can delete the last segment or split it in two.
Any segment, except the last one, can be muted by selecting it in the timeline and toggle mute. This can be used to guide the generation towards a specific result.
It will also help you keep VRAM under control by only having the necessary segments loaded.

If you only like the start of a clip, fear not, you can still accept it and move the end of the last segment to remove the unwanted part before the next generation. You can otionally use rewind as well.

Stage 1 is great for generating drafts since it's much faster than 1+2, although much lower quality. But remember to run stage 2 now and then to avoid surprises in the end 😁

The stage 2 refiner works in block of 6 seconds. The last section of the song might sound a bit off if the song length isn't exactly divisible by 6.

Troubleshooting

If the gradio server fails start with errno 111 on linux. You can try using an alternative ip address other than localhost.
Replace n.n.n.n with the new address and optionally change the port in the command below.

./start_linux.sh --server_name n.n.n.n --server_port 7860

Credits

• YuE Official multimodal-art-projection/YuE
• YuE-exllamav2 sgsdxzy/YuE-exllamav2
• YuE Interface alisson-anjos/YuE-Interface