提出新型攻击方法,让联邦学习模型输出更不可信。
Maximizing Uncertainty for Federated learning via Bayesian Optimisation-based Model Poisoning
- 用贝叶斯优化搜索恶意模型参数,放大全局模型不确定性
- 攻击使模型输出不确定性提升,最高达基线的2.3倍
- 适合研究联邦学习安全、对抗攻击的学者参考
随着从窄人工智能向超级人工智能演进,用户日益关注机器学习技术的隐私与可信度。可信度的核心指标是深度学习算法中固有的不确定性,包括模型参数、输入数据和预测结果。联邦学习(FL)通过不共享原始数据来保护隐私,但仍面临可信度挑战。恶意参与者可在训练中系统性注入有害参数,导致模型预测与生成能力下降,引发高不确定性。本文提出名为Delphi的新式模型投毒攻击,旨在最大化全局模型输出的不确定性。该方法利用第一隐藏层参数与不确定性的关系,结合贝叶斯优化(Delphi-BO)与最小二乘信赖域(Delphi-LSTR)寻找最优投毒参数。通过KL散度衡量不确定性,使预测分布逼近完全不确定状态。理论证明了攻击有效性,数值实验显示Delphi-BO产生的不确定性显著高于Delphi-LSTR,揭示了联邦学习系统在模型投毒攻击下的脆弱性。
原文摘要 · Abstract (English)
As we transition from Narrow Artificial Intelligence towards Artificial Super Intelligence, users are increasingly concerned about their privacy and the trustworthiness of machine learning (ML) technology. A common denominator for the metrics of trustworthiness is the quantification of uncertainty inherent in DL algorithms, and specifically in the model parameters, input data, and model predictions. One of the common approaches to address privacy-related issues in DL is to adopt distributed learning such as federated learning (FL), where private raw data is not shared among users. Despite the privacy-preserving mechanisms in FL, it still faces challenges in trustworthiness. Specifically, the malicious users, during training, can systematically create malicious model parameters to compromise the models predictive and generative capabilities, resulting in high uncertainty about their reliability. To demonstrate malicious behaviour, we propose a novel model poisoning attack method named Delphi which aims to maximise the uncertainty of the global model output. We achieve this by taking advantage of the relationship between the uncertainty and the model parameters of the first hidden layer of the local model. Delphi employs two types of optimisation , Bayesian Optimisation and Least Squares Trust Region, to search for the optimal poisoned model parameters, named as Delphi-BO and Delphi-LSTR. We quantify the uncertainty using the KL Divergence to minimise the distance of the predictive probability distribution towards an uncertain distribution of model output. Furthermore, we establish a mathematical proof for the attack effectiveness demonstrated in FL. Numerical results demonstrate that Delphi-BO induces a higher amount of uncertainty than Delphi-LSTR highlighting vulnerability of FL systems to model poisoning attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。