Skip to content

Commit

Permalink
Update index.html
Browse files Browse the repository at this point in the history
  • Loading branch information
lg-lg authored Oct 30, 2024
1 parent b5d2764 commit 37ca72c
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -80,10 +80,10 @@ <h2 class="title is-3">Abstract</h2>
Music is an integral part of human culture, embodying human intelligence and creativity, of which songs compose an essential part.
While various aspects of song generation have been explored by previous works, such as singing voice, vocal composition and instrumental arrangement, etc., generating songs with both vocals and accompaniment given lyrics remains a significant challenge, hindering the application of music generation models in the real world.
In this light, we propose <b>SongCreator</b>, a <b></b>song-generation</b> system designed to tackle this challenge.
The model features two novel designs: <b>a meticulously designed dual-sequence language model (DSLM) to capture the information of vocals and accompaniment for song generation, and an additional attention mask strategy for DSLM, which allows our model to understand, generate and edit songs, making it suitable for various song-related generation tasks.</b>
The model features two novel designs: <b>a meticulously designed dual-sequence language model (DSLM) to capture the information of vocals and accompaniment for song generation, and a series of attention mask strategies for DSLM, which allows our model to understand, generate and edit songs, making it suitable for various songrelated generation tasks by utilizing specific attention masks.</b>
Extensive experiments demonstrate the effectiveness of SongCreator by achieving state-of-the-art or competitive performances on <b>all eight tasks</b>.
Notably, it surpasses previous works by <b>a large margin</b> in <b>lyrics-to-song and lyrics-to-vocals</b>.
Additionally, it is able to independently control the acoustic conditions of the vocals and accompaniment in the generated song through different prompts, exhibiting its potential applicability.
Additionally, it is able to independently control the acoustic conditions of the vocals and accompaniment in the generated song through different audio prompts, exhibiting its potential applicability.
</p>
</div>

Expand Down

0 comments on commit 37ca72c

Please sign in to comment.