Model-based synthesis of plucked string instruments by using a class of scattering recurrent networks

• Published in: IEEE transaction on neural networks and learning systems 2000-01, Vol.11 (1), p.171-185
• Main Authors: Sheng-Fu Liang, Su, A.W.Y., Chin-Teng Lin
• Format: Article
• Language: English
• Subjects: Acoustic measurements; Acoustic scattering; Acoustics; Computer simulation; Electronic music; Frequency modulation; Instruments; Music; Network synthesis; Networks; Physics; Scattering; Strings; Supervised learning; Synthesis; Training data; Vibration measurement
• ISSN: 1045-9227; 2162-237X; 1941-0093; 2162-2388
• DOI: 10.1109/72.822519

A physical modeling method for electronic music synthesis of plucked-string tones by using recurrent networks is proposed. A scattering recurrent network (SRN) which is used to analyze string dynamics is built based on the physics of acoustic strings. The measured vibration of a plucked string is employed as the training data for the supervised learning of the SRN. After the network is well trained, it can be regarded as the virtual model for the measured string and used to generate tones which can be very close to those generated by its acoustic counterpart. The "virtual string" corresponding to the SRN can respond to different "plucks" just like a real string, which is impossible using traditional synthesis techniques such as frequency modulation and wavetable. The simulation of modeling a cello "A"-string demonstrates some encouraging results of the new music synthesis technique. Some aspects of modeling and synthesis procedures are also discussed.