Direct Mining of Subjectively Interesting Relational Patterns

• Main Authors: Guns, Tias, Aknin, Achille, Lijffijt, Jefrey, De Bie, Tijl
• Format: Conference Proceeding
• Language: English
• Subjects: Algorithm design and analysis; Data mining; Itemsets; Motion pictures; Programming; Relational databases
• ISSN: 2374-8486
• DOI: 10.1109/ICDM.2016.0112

Data is typically complex and relational. Therefore, the development of relational data mining methods is an increasingly active topic of research. Recent work has resulted in new formalisations of patterns in relational data and in a way to quantify their interestingness in a subjective manner, taking into account the data analyst's prior beliefs about the data. Yet, a scalable algorithm to find such most interesting patterns is lacking. We introduce a new algorithm based on two notions: (1) the use of Constraint Programming, which results in a notably shorter development time, faster runtimes, and more flexibility for extensions such as branch-and-bound search, and (2), the direct search for the most interesting patterns only, instead of exhaustive enumeration of patterns before ranking them. Through empirical evaluation, we find that our novel bounds yield speedups up to several orders of magnitude, especially on dense data with a simple schema. This makes it possible to mine the most subjectively-interesting relational patterns present in databases where this was previously impractical or impossible.