Hierarchical feature extraction by multi-layer non-negative matrix factorization network for classification task

In this paper, we propose multi-layer non-negative matrix factorization (NMF) network for classification task, which provides intuitively understandable hierarchical feature learning process. The layer-by-layer learning strategy was adopted through stacked NMF layers, which enforced non-negativity o...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2015-10, Vol.165, p.63-74
Main Authors: Song, Hyun Ah, Kim, Bo-Kyeong, Xuan, Thanh Luong, Lee, Soo-Young
Format: Article
Language:English
Subjects:
Hierarchical feature extraction
Multi-layer network
Non-negative matrix factorization
Unsupervised learning
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose multi-layer non-negative matrix factorization (NMF) network for classification task, which provides intuitively understandable hierarchical feature learning process. The layer-by-layer learning strategy was adopted through stacked NMF layers, which enforced non-negativity of both features and their coefficients. With the non-negativity constraint, the learning process revealed latent feature hierarchies in the complex data in intuitively understandable manner. The multi-layer NMF networks was investigated for classification task by studying various network architectures and nonlinear functions. The proposed multilayer NMF network was applied to document classification task, and demonstrated that our proposed multi-layer NMF network resulted in much better classification performance compared to single-layered network, even with the small number of features. Also, through intuitive learning process, the underlying structure of feature hierarchies was revealed for the complex document data.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2014.08.095