Tackling Multiplayer Interaction for Federated Generative Adversarial Networks

• Published in: IEEE transactions on mobile computing 2024-12, Vol.23 (12), p.14017-14030
• Main Authors: Hu, Chuang, Tu, Tianyu, Gong, Yili, Jiang, Jiawei, Zheng, Zhigao, Cheng, Dazhao
• Format: Magazinearticle
• Language: English
• Subjects: Computational modeling; Data heterogeneity; Game theory; Games; Generative adversarial networks; generative adversarial networks (GANs); Generators; multiplayer zero-sum games; Servers; Training
• ISSN: 1536-1233; 1558-0660
• DOI: 10.1109/TMC.2024.3438148

Generative Adversarial Networks (GANs) have become predominant in mobile computing for their ability to generate data. The concern for data privacy has made it arduous to collect large-scale datasets for GAN training on centralized servers. Federated Learning (FL) has emerged as a promising solution to address data privacy concerns. In this paper, we propose Oasis, a multiplayer-oriented federated GAN training system. We present a motivation, highlighting the Nash Equilibrium (NE) shift in vanilla federated GANs, exacerbated by data heterogeneity, leading to poor training performance with issues of vanishing gradient and mode collapse. To address mode collapse, Oasis extracts privacy-preserving data representations and generates a similarity table for clustering clients. Each group independently trains a GAN model and conducts distribution and fusion. By introducing a coordinator, Oasis generalizes intra-group games into Separable Zero-sum Multiplayer Games to tackle vanishing gradient. Thus, Oasis considers the overall federated GAN training as Group-wise Separable Zero-sum Multiplayer Games . Practically, we evaluate our theoretical results both on a hardware prototype and in a simulated environment. Evaluation results demonstrate the effectiveness of Oasis, with an average improvement of 23.13% and 26.33% in terms of FID and NDB/K respectively, compared to three state-of-the-art FL approaches over three datasets.