Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kjysmu authored Oct 27, 2023
1 parent 3590898 commit 774c561
Showing 1 changed file with 16 additions and 1 deletion.
17 changes: 16 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,22 @@ If you find this resource useful, [please cite the original work](https://arxiv.

Kang, J., Poria, S. & Herremans, D. (2023). Music Generation to Match Video using an Affective Multimodal Transformer model. arXiv preprint arXiv:XXX.

## Dataset files
## Getting Started
### Install Dependencies

### Download Pre-trained Checkpoints
We provide pre-trained AMT for generating music.
* `AMT` [(120 MB)](https://drive.google.com/file/d/1ZPQiTyz8wqxwPdYxYSCEtq4MLbR5s9jh/view?usp=drive_link)

### Obtain the Dataset
We provide the Muvi-Sync. [(5 MB)](https://drive.google.com/open?id=1JUDHGrVYGyHtjkfI2vgR1xb2oU8unlI3)
* `dataset/vevo_scene`: scene offset
* `dataset/vevo_motion`:

We provide the Muvi-Sync for audio and video. [(5 MB)]()
* `dataset/vevo_audio`: scene offset
* `dataset/vevo`:


## Affective Multimodal Transformer model

Expand Down

0 comments on commit 774c561

Please sign in to comment.