Genetic Algorithm-Based Structure Reduction for Convolutional Neural Network

Due to the heavy computational burden, deep models of embedded and mobile systems inevitably require network reduction with minimum performance degradation. Pruning method is mainly used to reduce the model by removing some filters only within the layer without changing the structure. Some methods f...

Full description

Saved in:
Bibliographic Details
Published in:Journal of electrical engineering & technology 2022, 17(5), , pp.3015-3020
Main Authors: Kang, Sungjae, Kim, Seong Soo, Seo, Kisung
Format: Article
Language:English
Subjects:
Electrical Engineering
Electrical Machines and Networks
Electronics and Microelectronics
Engineering
Instrumentation
Original Article
Power Electronics
전기공학
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Due to the heavy computational burden, deep models of embedded and mobile systems inevitably require network reduction with minimum performance degradation. Pruning method is mainly used to reduce the model by removing some filters only within the layer without changing the structure. Some methods for structural reduction of models are far from optimization. We propose a structure reduction method using a genetic algorithm to optimize the removal of reducible layers. Knowledge distillation is carried out to recover the resultant network. We evaluate our method for ResNet on two image classification datasets, CIFAR-10 and CIFAR-100. Experiments show that our method performs a significant improvement over other state-of-the-art methods.
ISSN:1975-0102
2093-7423
DOI:10.1007/s42835-022-01088-1