XNews

YuE2: open-source music generation model

YuE2: open-source music generation model

YuE2 is an open-source music generation model from HKUST, NYU, and Stanford that generates songs from lyrics and style descriptions. It first creates a melody and chord score that can be edited, then generates vocals and accompaniment. It supports cover songs and iterative refinement through dialogue.

Key insights

YuE2 generates editable intermediate scores for user control

Unlike black-box music generation, YuE2 produces a visible, editable score (melody and chords) that users can modify before final generation. Users can change harmony, tempo, or notes and regenerate. The model also supports cover songs: converting an existing recording to a score, then generating a new version with different lyrics or style.

Competitive with Suno v5/v6, free for personal and commercial use

In internal evaluations, YuE2 competes closely with Suno v5 and v6, with the README noting the top few models are very close. The model requires Linux with 24GB VRAM NVIDIA GPU and outputs 48kHz stereo. It is free for personal and commercial use, including monetization of generated works.

Source posts