Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy

Feature selection is a process that selects some important features from original feature set. Many existing feature selection algorithms based on information theory concentrate on maximizing relevance and minimizing redundancy. In this paper, relevance and redundancy are extended to conditional rel...

Full description

Saved in:
Bibliographic Details
Published in:Applied intelligence (Dordrecht, Netherlands) Netherlands), 2019-03, Vol.49 (3), p.883-896
Main Authors: Zhou, HongFang, Zhang, Yao, Zhang, YingJie, Liu, HongJiang
Format: Article
Language:English
Subjects:
Algorithms
Artificial Intelligence
Computer Science
Feature selection
Information theory
Machines
Manufacturing
Mechanical Engineering
Processes
Product acceptance
Production planning
Redundancy
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Feature selection is a process that selects some important features from original feature set. Many existing feature selection algorithms based on information theory concentrate on maximizing relevance and minimizing redundancy. In this paper, relevance and redundancy are extended to conditional relevance and conditional redundancy. Because of the natures of the two conditional relations, they tend to produce more accurate feature relations. A new frame integrating the two conditional relations is built in this paper and two new feature selection methods are proposed, which are Minimum Conditional Relevance-Minimum Conditional Redundancy (MCRMCR) and Minimum Conditional Relevance-Minimum Intra-Class Redundancy (MCRMICR) respectively. The proposed methods can select high class-relevance and low-redundancy features. Experimental results for twelve datasets verify the proposed methods perform better on feature selection and have high classification accuracy.
ISSN:0924-669X
1573-7497
DOI:10.1007/s10489-018-1305-0