DENSER: deep evolutionary network structured representation

Deep evolutionary network structured representation (DENSER) is a novel evolutionary approach for the automatic generation of deep neural networks (DNNs) which combines the principles of genetic algorithms (GAs) with those of dynamic structured grammatical evolution (DSGE). The GA-level encodes the...

Full description

Saved in:
Bibliographic Details
Published in:Genetic programming and evolvable machines 2019-03, Vol.20 (1), p.5-35
Main Authors: Assunção, Filipe, Lourenço, Nuno, Machado, Penousal, Ribeiro, Bernardete
Format: Article
Language:English
Subjects:
Artificial Intelligence
Artificial neural networks
Biological evolution
Biomedical Engineering and Bioengineering
Compilers
Computer Science
Electrical Engineering
Genetic algorithms
Interpreters
Neural networks
Parameters
Programming Languages
Programming Techniques
Rectangles
Representations
Software Engineering/Programming and Operating Systems
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep evolutionary network structured representation (DENSER) is a novel evolutionary approach for the automatic generation of deep neural networks (DNNs) which combines the principles of genetic algorithms (GAs) with those of dynamic structured grammatical evolution (DSGE). The GA-level encodes the macro structure of evolution, i.e., the layers, learning, and/or data augmentation methods (among others); the DSGE-level specifies the parameters of each GA evolutionary unit and the valid range of the parameters. The use of a grammar makes DENSER a general purpose framework for generating DNNs: one just needs to adapt the grammar to be able to deal with different network and layer types, problems, or even to change the range of the parameters. DENSER is tested on the automatic generation of convolutional neural networks (CNNs) for the CIFAR-10 dataset, with the best performing networks reaching accuracies of up to 95.22%. Furthermore, we take the fittest networks evolved on the CIFAR-10, and apply them to classify MNIST, Fashion-MNIST, SVHN, Rectangles, and CIFAR-100. The results show that the DNNs discovered by DENSER during evolution generalise, are robust, and scale. The most impressive result is the 78.75% classification accuracy on the CIFAR-100 dataset, which, to the best of our knowledge, sets a new state-of-the-art on methods that seek to automatically design CNNs.
ISSN:1389-2576
1573-7632
DOI:10.1007/s10710-018-9339-y