Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control

Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-07
Main Authors: Yu-Hua, Chen, Yen-Tung Yeh, Yuan-Chiao, Cheng, Wu, Jui-Te, Yu-Hsiang, Ho, Jang, Jyh-Shing Roger, Yang, Yi-Hsuan
Format: Article
Language:English
Subjects:
Amplifiers
Analog circuits
Embedding
Modelling
Representations
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Yu-Hua, Chen
Yen-Tung Yeh
Yuan-Chiao, Cheng
Wu, Jui-Te
Yu-Hsiang, Ho
Jang, Jyh-Shing Roger
Yang, Yi-Hsuan
description Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_3081472415</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3081472415</sourcerecordid><originalsourceid>FETCH-proquest_journals_30814724153</originalsourceid><addsrcrecordid>eNqNirEKwjAUAIMgWLT_EHAOtElri6sobi7dSzSvmpLk1SRV9OtVcHRwOri7CUm4EDmrC85nJA2hz7KMrypeliIhbYN36VWgT_DIwgUjlXYwutPgqUUFRrvzmh4csIjMSvf40elNSxrRAQV7BKU-6oQuejQLMu2kCZB-OSfL3bbZ7Nng8TpCiG2Po3fv1IqszouKF3kp_rte4QdE7Q</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3081472415</pqid></control><display><type>article</type><title>Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control</title><source>Publicly Available Content Database</source><creator>Yu-Hua, Chen ; Yen-Tung Yeh ; Yuan-Chiao, Cheng ; Wu, Jui-Te ; Yu-Hsiang, Ho ; Jang, Jyh-Shing Roger ; Yang, Yi-Hsuan</creator><creatorcontrib>Yu-Hua, Chen ; Yen-Tung Yeh ; Yuan-Chiao, Cheng ; Wu, Jui-Te ; Yu-Hsiang, Ho ; Jang, Jyh-Shing Roger ; Yang, Yi-Hsuan</creatorcontrib><description>Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Amplifiers ; Analog circuits ; Embedding ; Modelling ; Representations</subject><ispartof>arXiv.org, 2024-07</ispartof><rights>2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/3081472415?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Yu-Hua, Chen</creatorcontrib><creatorcontrib>Yen-Tung Yeh</creatorcontrib><creatorcontrib>Yuan-Chiao, Cheng</creatorcontrib><creatorcontrib>Wu, Jui-Te</creatorcontrib><creatorcontrib>Yu-Hsiang, Ho</creatorcontrib><creatorcontrib>Jang, Jyh-Shing Roger</creatorcontrib><creatorcontrib>Yang, Yi-Hsuan</creatorcontrib><title>Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control</title><title>arXiv.org</title><description>Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.</description><subject>Amplifiers</subject><subject>Analog circuits</subject><subject>Embedding</subject><subject>Modelling</subject><subject>Representations</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNirEKwjAUAIMgWLT_EHAOtElri6sobi7dSzSvmpLk1SRV9OtVcHRwOri7CUm4EDmrC85nJA2hz7KMrypeliIhbYN36VWgT_DIwgUjlXYwutPgqUUFRrvzmh4csIjMSvf40elNSxrRAQV7BKU-6oQuejQLMu2kCZB-OSfL3bbZ7Nng8TpCiG2Po3fv1IqszouKF3kp_rte4QdE7Q</recordid><startdate>20240715</startdate><enddate>20240715</enddate><creator>Yu-Hua, Chen</creator><creator>Yen-Tung Yeh</creator><creator>Yuan-Chiao, Cheng</creator><creator>Wu, Jui-Te</creator><creator>Yu-Hsiang, Ho</creator><creator>Jang, Jyh-Shing Roger</creator><creator>Yang, Yi-Hsuan</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20240715</creationdate><title>Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control</title><author>Yu-Hua, Chen ; Yen-Tung Yeh ; Yuan-Chiao, Cheng ; Wu, Jui-Te ; Yu-Hsiang, Ho ; Jang, Jyh-Shing Roger ; Yang, Yi-Hsuan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_30814724153</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Amplifiers</topic><topic>Analog circuits</topic><topic>Embedding</topic><topic>Modelling</topic><topic>Representations</topic><toplevel>online_resources</toplevel><creatorcontrib>Yu-Hua, Chen</creatorcontrib><creatorcontrib>Yen-Tung Yeh</creatorcontrib><creatorcontrib>Yuan-Chiao, Cheng</creatorcontrib><creatorcontrib>Wu, Jui-Te</creatorcontrib><creatorcontrib>Yu-Hsiang, Ho</creatorcontrib><creatorcontrib>Jang, Jyh-Shing Roger</creatorcontrib><creatorcontrib>Yang, Yi-Hsuan</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yu-Hua, Chen</au><au>Yen-Tung Yeh</au><au>Yuan-Chiao, Cheng</au><au>Wu, Jui-Te</au><au>Yu-Hsiang, Ho</au><au>Jang, Jyh-Shing Roger</au><au>Yang, Yi-Hsuan</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control</atitle><jtitle>arXiv.org</jtitle><date>2024-07-15</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2024-07
issn 2331-8422
language eng
recordid cdi_proquest_journals_3081472415
source Publicly Available Content Database
subjects Amplifiers
Analog circuits
Embedding
Modelling
Representations
title Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T21%3A00%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Towards%20zero-shot%20amplifier%20modeling:%20One-to-many%20amplifier%20modeling%20via%20tone%20embedding%20control&rft.jtitle=arXiv.org&rft.au=Yu-Hua,%20Chen&rft.date=2024-07-15&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E3081472415%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_30814724153%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=3081472415&rft_id=info:pmid/&rfr_iscdi=true