Exploiting False Discoveries -- Statistical Validation of Patterns and Quality Measures in Subgroup Discovery

Subgroup discovery suffers from the multiple comparisons problem: we search through a large space, hence whenever we report a set of discoveries, this set will generally contain false discoveries. We propose a method to compare subgroups found through subgroup discovery with a statistical model we b...

Full description

Saved in:
Bibliographic Details
Main Authors: Duivesteijn, W., Knobbe, A.
Format: Conference Proceeding
Language:English
Subjects:
Association rules
Complexity theory
Histograms
Search problems
Silicon
Size measurement
Statistical validation
subgroup discovery
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Subgroup discovery suffers from the multiple comparisons problem: we search through a large space, hence whenever we report a set of discoveries, this set will generally contain false discoveries. We propose a method to compare subgroups found through subgroup discovery with a statistical model we build for these false discoveries. We determine how much the subgroups we find deviate from the model, and hence statistically validate the found subgroups. Furthermore we propose to use this subgroup validation to objectively compare quality measures used in subgroup discovery, by determining how much the top subgroups we find with each measure deviate from the statistical model generated with that measure. We thus aim to determine how good individual measures are in selecting significant findings. We invoke our method to experimentally compare popular quality measures in several subgroup discovery settings.
ISSN:1550-4786
2374-8486
DOI:10.1109/ICDM.2011.65