LONGITUDINAL CLUSTERING FOR HETEROGENEOUS BINARY DATA

• Published in: Statistica Sinica 2021-01, Vol.31 (2), p.603-624
• Main Authors: Zhu, Xiaolu, Tang, Xiwei, Qu, Annie
• Format: Article
• Language: English
• ISSN: 1017-0405; 1996-8507
• DOI: 10.5705/ss.202018.0298

Personalized marketing has emerged as a critical marketing strategy as a result of the success of e-commerce and the accessibility of digital marketing data. It is well known that different groups of customers might react differently to the same marketing strategy, owing to their individual preferences. As such, we propose a pairwise subgrouping approach that can be used to identify subgroups and categorize similar marketing effects into groups. Specifically, we model customers’ purchase decisions as binary responses under a generalized linear model framework, while incorporating their longitudinal correlation. We penalize the pairwise distances between heterogeneous effects to formulate subgroups, where a subgroup is associated with a unique marketing effect. We establish the theoretical consistency of the subgroup identification in the sense that the true underlying segmentation structure can be recovered successfully. Here, we also establish the parameter estimation consistency. We conduct numerical studies and apply the proposed approach to IRI marketing data on in-store display marketing effects. The results show that the proposed method outperforms competing methods in terms of identifying subgroups and estimating marketing effects.