Multisensory Concept Learning Framework Based on Spiking Neural Networks

Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, a...

Full description

Saved in:
Bibliographic Details
Published in:Frontiers in systems neuroscience 2022-05, Vol.16, p.845177-845177
Main Authors: Wang, Yuwei, Zeng, Yi
Format: Article
Language:English
Subjects:
Associate Merge
brain-inspired
concept learning
Independent Merge
multisensory
Neuroscience
spiking neural networks
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, and visual. With different assumptions, two paradigms: Independent Merge (IM) and Associate Merge (AM) are designed in the framework. For testing, we employed eight distinct neural models and three multisensory representation datasets. The experiments show that integrated vectors are closer to human beings than the non-integrated ones. Furthermore, we systematically analyze the similarities and differences between IM and AM paradigms and validate the generality of our framework.
ISSN:1662-5137
1662-5137
DOI:10.3389/fnsys.2022.845177