Bilinear Feature Fusion Convolutional Neural Network for Distributed Tactile Pressure Recognition and Understanding via Visualization

Distributed tactile pressure recognition is an important task in intelligent industry. In this article, convolutional neural network (CNN) has attracted attention for their ability to automatically extract features and complete recognition. However, there are still the following weaknesses. The pres...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on industrial electronics (1982) 2022-06, Vol.69 (6), p.6391-6400
Main Authors: Chu, Jie, Cai, Jueping, Li, Long, Fan, Yang, Su, Bowen
Format: Article
Language:English
Subjects:
Algorithms
Artificial neural networks
Bilinear feature
Correlation coefficient
Feature extraction
feature fusion
Feature recognition
fused gradient class activation map (F-Grad-CAM)
High resolution
Image edge detection
Image resolution
Neural networks
pressure recognition
Shape
Task analysis
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Distributed tactile pressure recognition is an important task in intelligent industry. In this article, convolutional neural network (CNN) has attracted attention for their ability to automatically extract features and complete recognition. However, there are still the following weaknesses. The pressure information is low-resolution based on sensor density, resulting in limited configurable network depth. The current CNNs are deep network for high-resolution image, so they are not applicable for pressure task. What CNN has learned from the pressure is not clear. Therefore, a bilinear feature fusion CNN (BF-CNN) is proposed. The bilinear features are used to improve the feature extraction capability by depicting second-order characteristics, and fusion strategy is applied to promote the efficiency of feature utilization through the complementarity of hierarchical features. To understand BF-CNN intuitively, we develop the fused gradient class activation map (F-Grad-CAM) algorithm to visualize the regions of interest of the samples in detail, using multi-scale features to provide high-resolution heat maps. We also construct a pressure image dataset of 26 (A-Z) letter-shapes with complex contours collected by a 16 × 16 pressure array to validate the proposed models. The results show our work achieved highest accuracy of 98.23% and provided a more detailed location on activated areas.
ISSN:0278-0046
1557-9948
DOI:10.1109/TIE.2021.3086714