通过个体去学习识别联邦学习中的后门模型
Identify Backdoored Model in Federated Learning via Individual Unlearning
- 利用本地模型在干净数据上的去学习行为检测异常参数
- 在六种攻击下均实现高精度识别,非独立同分布场景仍有效
- 首次将机器去学习用于联邦学习后门检测,适合安全研究者
后门攻击对联邦学习系统的鲁棒性构成重大威胁,因其隐蔽性和有效性,恶意模型在主任务和后门任务上同时表现良好,导致其统计特性与良性模型相似,从而规避现有防御方法。我们发现恶意模型中的参数在主任务上处于非活跃状态,导致在干净输入上的去学习过程中产生显著更高的经验损失。受此启发,我们提出MASA方法,通过在本地模型上执行个体去学习来识别恶意模型。为提升MASA在非独立同分布(non-IID)设置下的性能,我们设计了预去学习模型融合机制,通过整合来自其他数据集的知识,缓解因客户端数据分布差异引起的去学习行为偏差。此外,我们提出一种超参数极少的新型异常检测指标,可高效过滤恶意模型。在六个不同攻击场景下的独立同分布与非独立同分布数据集上进行的大量实验验证了MASA的有效性。据我们所知,这是首个利用机器去学习识别联邦学习中恶意模型的工作。代码已开源。
原文摘要 · Abstract (English)
Backdoor attacks present a significant threat to the robustness of Federated Learning (FL) due to their stealth and effectiveness. They maintain both the main task of the FL system and the backdoor task simultaneously, causing malicious models to appear statistically similar to benign ones, which enables them to evade detection by existing defense methods. We find that malicious parameters in backdoored models are inactive on the main task, resulting in a significantly large empirical loss during the machine unlearning process on clean inputs. Inspired by this, we propose MASA, a method that utilizes individual unlearning on local models to identify malicious models in FL. To improve the performance of MASA in challenging non-independent and identically distributed (non-IID) settings, we design pre-unlearning model fusion that integrates local models with knowledge learned from other datasets to mitigate the divergence in their unlearning behaviors caused by the non-IID data distributions of clients. Additionally, we propose a new anomaly detection metric with minimal hyperparameters to filter out malicious models efficiently. Extensive experiments on IID and non-IID datasets across six different attacks validate the effectiveness of MASA. To the best of our knowledge, this is the first work to leverage machine unlearning to identify malicious models in FL. Code is available at \url{https://github.com/JiiahaoXU/MASA}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。