| Paper ID | MLSP-12.4 | ||
| Paper Title | DP-SIGNSGD: WHEN EFFICIENCY MEETS PRIVACY AND ROBUSTNESS | ||
| Authors | Lingjuan Lyu, Ant Group, Singapore | ||
| Session | MLSP-12: Federated Learning 1 | ||
| Location | Gather.Town | ||
| Session Time: | Wednesday, 09 June, 13:00 - 13:45 | ||
| Presentation Time: | Wednesday, 09 June, 13:00 - 13:45 | ||
| Presentation | Poster | ||
| Topic | Machine Learning for Signal Processing: [MLR-DFED] Distributed/Federated learning | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | Federated learning (FL) has emerged as a promising collab- oration paradigm by enabling a multitude of parties to con- struct a joint model without exposing their private training data. Three main challenges in FL are efficiency, privacy, and robustness. The recently proposed SIGNSGD with majority vote shows a promising direction to deal with efficiency and Byzantine robustness. However, there is no guarantee that SIGNSGD is privacy-preserving. In this paper, we bridge this gap by presenting an improved method called DP-SIGNSGD, which can enjoy all the aforementioned properties. We also present an error-feedback variant of the proposed DP-SIGNSGD which further improves the learning performance in FL. We experimentally demonstrate the effectiveness of our proposed methods with extensive experiments on the image datasets. | ||