Scalable and Secure Federated XGBoost

Federated learning (FL) is the distributed machine learning framework that enables collaborative training across multiple parties while ensuring data privacy. Practical adaptation of XGBoost, the state-of-the-art tree boosting framework, to FL remains nascent due to high cost incurred by conventiona...

Full description

Saved in:
Bibliographic Details
Main Authors: Nguyen, Quang Minh, Khanh Le, Nhan, Nguyen, Lam M.
Format: Conference Proceeding
Language:English
Subjects:
communication
Data privacy
Federated learning
Privacy
Protocols
Signal processing algorithms
Training
Wireless communication
XGBoost
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Federated learning (FL) is the distributed machine learning framework that enables collaborative training across multiple parties while ensuring data privacy. Practical adaptation of XGBoost, the state-of-the-art tree boosting framework, to FL remains nascent due to high cost incurred by conventional privacy-preserving methods. Such limitations can be attributed to the lack of formal analytical model to enable new privacy methods well customized to federated XGBoost. To this end, we propose a novel formulation, termed splitting matrix, in the context of federated XGBoost that mathematically characterizes the role of passive party (PP) having been neglected in the literature. This new formulation facilitates our novel adoption of secure matrix multiplication protocol into federated XGBoost to propose FedXGBoost as a framework for secure XGBoost in federated setting with lossless accuracy and negligible overhead. Extensive experiments on both synthetic and real datasets exhibit our algorithm's empirical outperformance over known methods in the literature.
ISSN:2379-190X
DOI:10.1109/ICASSP49357.2023.10097233