An Adversarial Approach to Protocol Analysis and Selection in Local Differential Privacy

• Published in: IEEE transactions on information forensics and security 2022, Vol.17, p.1785-1799
• Main Authors: Gursoy, M. Emre, Liu, Ling, Chow, Ka-Ho, Truex, Stacey, Wei, Wenqi
• Format: Article
• Language: English
• Subjects: adversarial analysis; Bayes methods; Bayesian analysis; Budgets; Data collection; Data privacy; Differential privacy; Empirical analysis; Encoding; Estimation; Hash functions; Privacy; privacy-preserving data collection; Protocol; Protocols; Servers
• ISSN: 1556-6013; 1556-6021
• DOI: 10.1109/TIFS.2022.3170242

Local Differential Privacy (LDP) is a popular standard for privacy-preserving data collection. Numerous LDP protocols have been proposed in the literature which differ in how they provide higher utility in different settings. Yet, few have engaged in analyzing the privacy relationships of these protocols under varying settings, and consequently, it is non-trivial to select which LDP protocol is best to use in a newly emerging application. In this paper, we present an adversarial approach to protocol analysis and selection and make three original contributions. First, we introduce a Bayesian adversary to analyze the privacy relationships of LDP protocols under varying settings. We show that different protocols have substantially different responses to the attack effectiveness of the Bayesian adversary, measured in terms of Adversarial Success Rate (ASR). Second, we provide a formal and empirical analysis on a set of privacy and utility-critical factors, including encoding parameters, privacy budget, data domain, adversarial knowledge, and statistical distribution. We show that different settings of these factors have significant effects on the ASRs of LDP protocols, and no protocol provides consistently low ASR across all settings. Third, we design and develop LDPLens, a prototype implementation of our proposed framework. Given a data collection scenario with various factors and constraints, LDPLens enables optimized selection of a desirable LDP protocol for the given scenario. We evaluate the effectiveness of LDPLens using three case studies with real-world datasets. Results show that LDPLens recommends a different protocol in each case study, and the protocol recommended by LDPLens can yield up to 1.5-2 fold reduction in utility loss, ASR or privacy budget compared to a randomly selected protocol.