Skopus: Mining top-k sequential patterns under leverage

• Published in: Data mining and knowledge discovery 2016-09, Vol.30 (5), p.1086-1111
• Main Authors: Petitjean, François, Li, Tao, Tatti, Nikolaj, Webb, Geoffrey I.
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial Intelligence; Chemistry and Earth Sciences; Computer Science; Consistency; Construction; Data mining; Data Mining and Knowledge Discovery; Experiments; Information Storage and Retrieval; Partitions; Physics; State of the art; Statistics for Engineering
• ISSN: 1384-5810; 1573-756X
• DOI: 10.1007/s10618-016-0467-9

This paper presents a framework for exact discovery of the top- k sequential patterns under Leverage. It combines (1) a novel definition of the expected support for a sequential pattern—a concept on which most interestingness measures directly rely—with (2) Skopus: a new branch-and-bound algorithm for the exact discovery of top- k sequential patterns under a given measure of interest. Our interestingness measure employs the partition approach. A pattern is interesting to the extent that it is more frequent than can be explained by assuming independence between any of the pairs of patterns from which it can be composed. The larger the support compared to the expectation under independence, the more interesting is the pattern. We build on these two elements to exactly extract the k sequential patterns with highest leverage, consistent with our definition of expected support. We conduct experiments on both synthetic data with known patterns and real-world datasets; both experiments confirm the consistency and relevance of our approach with regard to the state of the art.