用可解释AI验证机器遗忘效果,提升隐私合规性。
Verifying Machine Unlearning with Explainable AI
- 通过特征重要性等XAI方法验证模型是否真正遗忘数据。
- 提出两种新指标:热图覆盖率与注意力迁移,量化遗忘效果。
- 适合关注数据隐私与模型可解释性的研究者与工程师。
我们研究可解释AI(XAI)在港口前端监控场景下验证机器遗忘(MU)的有效性,聚焦数据隐私与合规性。随着《通用数据保护条例》(GDPR)等法规要求日益严格,传统通过重训练实现数据删除的方法因复杂性和资源消耗过大而不可行。机器遗忘通过选择性消除特定学习模式,无需完整重训练即可实现数据删除。本文探索了数据重标注与模型扰动等多种遗忘技术,并利用基于归因的XAI分析遗忘对模型性能的影响。我们的概念验证引入特征重要性作为创新的验证步骤,超越传统指标,证明了这些技术能有效降低对不希望保留模式的依赖。此外,我们提出了两个新型XAI指标:热图覆盖率(HC)和注意力转移(AS),用于评估遗忘方法的有效性。该方法不仅表明XAI可有效补充机器遗忘的验证,也为未来两者融合研究奠定基础。
原文摘要 · Abstract (English)
We investigate the effectiveness of Explainable AI (XAI) in verifying Machine Unlearning (MU) within the context of harbor front monitoring, focusing on data privacy and regulatory compliance. With the increasing need to adhere to privacy legislation such as the General Data Protection Regulation (GDPR), traditional methods of retraining ML models for data deletions prove impractical due to their complexity and resource demands. MU offers a solution by enabling models to selectively forget specific learned patterns without full retraining. We explore various removal techniques, including data relabeling, and model perturbation. Then, we leverage attribution-based XAI to discuss the effects of unlearning on model performance. Our proof-of-concept introduces feature importance as an innovative verification step for MU, expanding beyond traditional metrics and demonstrating techniques' ability to reduce reliance on undesired patterns. Additionally, we propose two novel XAI-based metrics, Heatmap Coverage (HC) and Attention Shift (AS), to evaluate the effectiveness of these methods. This approach not only highlights how XAI can complement MU by providing effective verification, but also sets the stage for future research to enhance their joint integration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。