Visual‐Audio Thermoelectric Detectors for Images and Sound Recognition

• Published in: Advanced functional materials 2024-11, Vol.34 (46), p.n/a
• Main Authors: Liu, Zekun, Zhang, Shuai, Wu, Zhenhua, Wang, Xing‐Er, Zou, Kangning, Zhu, Zhiyuan, Wang, Xuyu, Mu, Erzhen, Zhang, Xiaotian, Liu, Yan, Shi, Huilie, Hu, Zhiyu
• Format: Article
• Language: English
• Subjects: Acoustic frequencies; acoustic‐thermal‐electric effect; Bionics; Clean energy; Digital imaging; Energy conversion; Image acquisition; image and music recognition; Loudness; Music; photo‐thermal‐electric effect; Physiological effects; Sensory perception; Thermal energy; thermoelectric; Thermoelectricity; Visual effects
• ISSN: 1616-301X; 1616-3028
• DOI: 10.1002/adfm.202406110

Inherent in humans is the capacity to perceive music and art, engaging both the visual and auditory senses, with profound effects on physiological and psychological states. Sound and light possess the remarkable ability to transform into thermal energy and, ultimately, electrical signals, playing a crucial role in human sensory perception. This research introduces a previously unmentioned synesthesia‐inspired image and sound recognition system, diverging from conventional image/sound acquisition techniques based on photo/mechanical‐electrical conversion. Leveraging the photo/acoustic‐thermal‐electric effects, the system utilizes micro‐/commercial thermoelectric devices as a conduit for energy conversion. It successfully discriminates monochromatic red, green, blue (RGB) and color coverage, showcasing its proficiency in distinguishing ten digital paintings. Additionally, by probing fiber responses to varied sound frequencies and loudness levels, the system achieves time‐domain identification of four classical music compositions. The device exhibits high sensitivity to detecting input energy and its inputting rate power, offering a novel approach to image and sound recognition through thermal signals. Potential applications span from bionic image sensors and time‐domain thermal monitoring of audio. With further exploration, this thermoelectric‐based system holds promise in quantifying emotional responses to images and sound. This research introduces a previously unmentioned synesthesia‐like complex image and sound recognition system based on photo/acoustic‐thermal‐electric effects. It successfully discriminates monochromatic RGB and color coverage, showcasing its proficiency in distinguishing ten digital paintings. Additionally, the system achieves time‐domain identification of four classical music compositions. It holds promise in quantifying emotional responses to images and sound.