Efficient neural networks for edge devices

Due to limited computation and storage resources of industrial internet of things (IoT) edge devices, many emerging intelligent industrial IoT applications based on deep neural networks (DNNs) heavily depend on cloud computing for computation and storage. However, cloud computing faces technical iss...

Full description

Saved in:
Bibliographic Details
Published in:Computers & electrical engineering 2021-06, Vol.92, p.107121, Article 107121
Main Authors: Liu, Shiya, Ha, Dong Sam, Shen, Fangyang, Yi, Yang
Format: Article
Language:English
Subjects:
Artificial neural networks
Cloud computing
Computer architecture
Data processing
Edge computing
Edge devices
Electronic devices
Industrial applications
Internet of Things
Network latency
Neural network
Neural networks
Pruning
Quantization
Real time
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Due to limited computation and storage resources of industrial internet of things (IoT) edge devices, many emerging intelligent industrial IoT applications based on deep neural networks (DNNs) heavily depend on cloud computing for computation and storage. However, cloud computing faces technical issues in long latency, poor reliability, and weak privacy, resulting in the need for on-device computation and storage. On-device computation is essential for many time-critical industrial IoT applications, which require real-time data processing. In this paper, we review three major research areas for on-device computation, specifically quantization, pruning, and network architecture design. The three techniques could enable a DNN model to be deployed on edge devices for real-time computation and storage, mainly due to the reduction of computation and space complexity. More importantly, these techniques could make DNNs applicable to industrial IoT devices.
ISSN:0045-7906
1879-0755
DOI:10.1016/j.compeleceng.2021.107121