Modeling Melodic Feature Dependency with Modularized Variational Auto-encoder

Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly challenging. This paper introduces 1) a new variant of variational autoencoder (VAE), where the model structure is designed...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Yu-An, Huang, Yu-Kai, Lin, Tzu-Chuan, Su, Shang-Yu, Chen, Yun-Nung
Format: Conference Proceeding
Language:English
Subjects:
Modularization
Music Generation
VAE
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly challenging. This paper introduces 1) a new variant of variational autoencoder (VAE), where the model structure is designed in a modularized manner in order to model polyphonic and dynamic music with domain knowledge, and 2) a hierarchical encoding/decoding strategy, which explicitly models the dependency between melodic features. The proposed framework is capable of generating distinct melodies that sounds natural, and the experiments for evaluating generated music clips show that the proposed model outperforms the baselines in human evaluation. 1
ISSN:2379-190X
DOI:10.1109/ICASSP.2019.8683106