RhythmCAN – Generating novel rhythm patterns using GAN with Genre Ambiguity Loss

Warning: Undefined array key "v" in /pub/WWW/cclab/wp-content/themes/kalium/includes/classes/core/kalium-media.php on line 117

Nao Tokui

Tokui, Nao. 2020. “Can GAN Originate New Electronic Dance Music Genres? — Generating Novel Rhythm Patterns Using GAN with Genre Ambiguity Loss.” arXiv [cs.SD]. arXiv. http://arxiv.org/abs/2011.13062.

Can we use AI, more specifically GAN, to originate new electronic dance music genres?

Project overview

Since the introduction of deep learning, researchers have proposed content generation systems using deep learning and proved that they are competent to generate convincing content and artistic output, including music. However, one can argue that these deep learning-based systems imitate and reproduce the patterns inherent within what humans have created, instead of generating something new and creative.

In this paper, we focus on music generation, especially rhythm patterns of electronic dance music, and discuss if we can use deep learning to generate novel rhythms, interesting patterns not found in the training dataset.

We extend the framework of Generative Adversarial Networks(GAN) and encourage it to diverge from the inherent distributions in the dataset by adding additional classifiers to the framework. The paper shows that our proposed GAN can generate rhythm patterns that sound like music rhythms but not belong to any genre in the training dataset.

The source code, generated rhythm patterns, and supplementary plugin software for a popular Digital Audio Workstation software are available on our website.

Generated Rhythm Samples

Proposed Method: GAN with Genre Ambiguity Loss

Genre-Conditioned GAN (comparison)

We have provided scripts for training your own model and an Ableton Live M4L Device to generate and play rhythm patterns generated by the model.

Music composed with the proposed model

Synthetic Soundscape (2021) Nao Tokui