SRCNN-PIL: Side Road Convolution Neural Network Based on Pseudoinverse Learning Algorithm

Deep neural networks offer advanced procedures for many learning tasks because of the ability to extract preferable features at every network layer. The evolved efficiency of extra layers inside a deep network will come at the expense of appended latency and power consumption in feedforward inferenc...

Full description

Saved in:
Bibliographic Details
Published in:Neural processing letters 2021-12, Vol.53 (6), p.4225-4237
Main Authors: Mahmoud, Mohammed A. B., Guo, Ping, Fathy, Ahmed, Li, Kan
Format: Article
Language:English
Subjects:
Accuracy
Algorithms
Artificial Intelligence
Artificial neural networks
Classification
Classifiers
Cognitive tasks
Complex Systems
Computational Intelligence
Computer Science
Machine learning
Network latency
Neural networks
Optimization
Power consumption
Probability
Roads
Roads & highways
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep neural networks offer advanced procedures for many learning tasks because of the ability to extract preferable features at every network layer. The evolved efficiency of extra layers inside a deep network will come at the expense of appended latency and power consumption in feedforward inference. As networks continue to grow and deepen, these outcomes become exceedingly prohibitive for energy-sensitive and real-time software. To overcome this problem, we propose the Side Road Network (SRN), an innovative deep network structure that is enhanced with further side road (SR) classifiers. The SR classifiers are trained by Pseudoinverse learning algorithm (PIL). The PIL algorithm does not integrate crucial user-dependent parameters such as momentum constant or learning rate. The SRN structure allows the prediction of results for a major portion of test samples to exit the network earlier via these SR classifiers since samples can be inferred with certainty. We analyze SRN structure using different models such as VGG, ResNet, WRN, and MobileNet. We evaluate the performance of SRN on three image datasets—CIFAR10, CIFAR100, and Tiny ImageNet—and show that it can improve the model prediction at earlier layers.
ISSN:1370-4621
1573-773X
DOI:10.1007/s11063-021-10595-7