Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation

Synthesizer is a type of electronic musical instrument that is now widely used in modern music production and sound design. Each parameters configuration of a synthesizer produces a unique timbre and can be viewed as a unique instrument. The problem of estimating a set of parameters configuration th...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2022-07
Main Authors: Chen, Zui, Yansen Jing, Yuan, Shengcheng, Xu, Yifei, Wu, Jian, Zhao, Hang
Format: Article
Language:English
Subjects:
Configuration management
Design parameters
Musical instruments
Parameter estimation
Sound
Synthesis
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Synthesizer is a type of electronic musical instrument that is now widely used in modern music production and sound design. Each parameters configuration of a synthesizer produces a unique timbre and can be viewed as a unique instrument. The problem of estimating a set of parameters configuration that best restore a sound timbre is an important yet complicated problem, i.e.: the synthesizer parameters estimation problem. We proposed a multi-modal deep-learning-based pipeline Sound2Synth, together with a network structure Prime-Dilated Convolution (PDC) specially designed to solve this problem. Our method achieved not only SOTA but also the first real-world applicable results on Dexed synthesizer, a popular FM synthesizer.
ISSN:2331-8422
DOI:10.48550/arxiv.2205.03043