MINTIN: Maxout-Based and Input-Normalized Transformation Invariant Neural Network

Convolutional Neural Network (CNN) is a powerful model for image classification, but it is insufficient to deal with the spatial variance of the input. This paper presents a Maxout-based and input-normalized transformation invariant neural network (MINTIN), which aims at addressing the nuisance vari...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Jingyang, Jia, Kaige, Yang, Pengshuai, Qiao, Fei, Wei, Qi, Liu, Xinjun, Yang, Huazhong
Format: Conference Proceeding
Language:English
Subjects:
Calibration
Computer vision
Error analysis
Feature extraction
Kernel
Maxout
Network topology
Neural networks
Normalization
transformation invariant
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Convolutional Neural Network (CNN) is a powerful model for image classification, but it is insufficient to deal with the spatial variance of the input. This paper presents a Maxout-based and input-normalized transformation invariant neural network (MINTIN), which aims at addressing the nuisance variation of images and accumulating transformation invariance. We introduce an innovative module, the Normalization, and combine it with the Maxout operator. While the former focuses on each image itself, the latter pays attention to augmented versions of input, resulting in fully-utilized information. This combination, which can be inserted into existing CNN architectures, enables the network to learn invariance to rotation and scaling. While the authors of TI-POOLING acclaimed that they reached state-of-the-art results, ours reach a maximum decrease of 0.71%, 0.23% and 0.51% in error rate on MNIST-rot-12k, half-rotated MNIST and scaling MNIST, respectively. The size of the network is also significantly reduced, leading to high computational efficiency.
ISSN:2381-8549
DOI:10.1109/ICIP.2018.8451468