arXiv:2605.08616cs.LG2026-05中稿 · the 2nd Internatio…

提出防御不可靠客户端的公平性保护机制,单轮通信下仍能提升模型公平性。

Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning

论文配图:Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning
图 1 · 摘自论文原文
  • 基于双层优化设计服务器端防御框架,动态调整客户端权重。
  • 使用少量可信数据集,在偏差数据下提升公平性,准确率损失小。
  • 适用于多数客户端不可靠的场景,适合隐私保护与高效协作的场景。

协同机器学习(CML)允许多个客户端在数据分散的环境下联合训练全局模型。为兼顾数据隐私与通信效率,单轮协同学习(one-shot CML)被广泛采用,客户端仅通过共享合成或处理后的代理数据与服务器通信一次。然而,这种单轮通信方式无法进行迭代修正,使学习过程易受客户端不可靠性影响。不可靠客户端(无论恶意与否)可能提供偏向特定群体的代理数据,导致全局模型不公平,损害少数或弱势群体。本文提出一种基于双层优化的服务器端防御框架,通过利用服务器端少量可信根数据集,学习客户端权重以缓解偏差数据的影响,并引入公平性约束。在基准数据集上的实验表明,该方法在不可靠客户端贡献偏差代理数据时,显著提升公平性且准确率损失极小。即使不可靠客户端占多数,该方法仍持续优于现有方法。

原文摘要 · Abstract (English)

Collaborative machine learning (CML) enables multiple clients to train a global model jointly in a data-distributed setting. To address data privacy and communication efficiency, one-shot CML has been increasingly adopted, where clients communicate with the server only once by sharing synthetic or processed proxy data. This single-round communication, however, eliminates the possibility of iterative correction at the server, making the learning process particularly vulnerable to client unreliability. In this setting, unreliable clients, whether malicious or non-malicious, may provide biased proxy data that favors certain groups, thereby degrading the fairness of the global model and harming minority or unprivileged groups. In this work, we propose a server-side defense framework based on a bilevel optimization formulation. The proposed approach learns client-level weights to mitigate the influence of biased client proxy data while enforcing fairness constraints by using a very small trusted root dataset available at the server. Experimental results on benchmark datasets show that our method improves fairness with little accuracy loss under biased proxy data contributions from unreliable clients. Moreover, the proposed approach remains effective even when unreliable clients make up a majority of the system, consistently outperforming other existing methods.

协同学习公平性防御机制单轮通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。