The use of information and information gain in the analysis of attribute dependencies

This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of...

Full description

Saved in:
Bibliographic Details
Published in:Biometrical letters 2012-12, Vol.49 (2), p.149-158
Main Authors: Moliński, Krzysztof, Dobek, Anita, Tomaszyk, Kamila
Format: Article
Language:English
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of attributes and testing of their independencies are shown. It follows that a complete exploration of data sets requires both of these elements. A new concept introduced in this paper is that of normed information gain, allowing the use of any logarithm in the definition of entropy.
ISSN:1896-3811
2199-577X
DOI:10.2478/bile-2013-0011