通过类别感知表征变换实现联邦学习中数据遗忘,兼顾隐私与模型性能。
Forgetting Through Transforming: Enabling Federated Unlearning via Class-Aware Representation Transformation
- 基于类别感知的表征变换策略选择遗忘方向
- 100%清除目标类影响,剩余类别性能不降反升
- 适合需要精准删除特定数据的隐私敏感场景
联邦遗忘(Federated Unlearning, FU)使客户端能够选择性地消除特定数据对已训练联邦模型的影响,解决隐私和合规问题。然而,现有方法在非独立同分布(Non-IID)设置下难以平衡有效擦除与模型效用保持,尤其在类别级遗忘方面表现不佳。本文提出一种新型方法FUCRT:基于类别感知表征变换的联邦遗忘。FUCRT包含两个核心组件:(1) 变换类别选择策略,用于识别最优遗忘方向;(2) 基于双类别感知对比学习的变换对齐技术,确保各客户端间变换一致性。在四个数据集上的大量实验表明,FUCRT在擦除保证、模型效用保持和效率方面均显著优于现有基线。其可在完全(100%)擦除目标类别影响的同时,维持甚至提升其余类别的性能,在IID与Non-IID设置下均表现优异。对表示空间的分析显示,FUCRT能有效将目标类别表征与剩余类别变换类合并,接近从头重新训练的模型效果。
原文摘要 · Abstract (English)
Federated Unlearning (FU) enables clients to selectively remove the influence of specific data from a trained federated learning model, addressing privacy concerns and regulatory requirements. However, existing FU methods often struggle to balance effective erasure with model utility preservation, especially for class-level unlearning in non-IID settings. We propose Federated Unlearning via Class-aware Representation Transformation (FUCRT), a novel method that achieves unlearning through class-aware representation transformation. FUCRT employs two key components: (1) a transformation class selection strategy to identify optimal forgetting directions, and (2) a transformation alignment technique using dual class-aware contrastive learning to ensure consistent transformations across clients. Extensive experiments on four datasets demonstrate FUCRT's superior performance in terms of erasure guarantee, model utility preservation, and efficiency. FUCRT achieves complete (100\%) erasure of unlearning classes while maintaining or improving performance on remaining classes, outperforming state-of-the-art baselines across both IID and Non-IID settings. Analysis of the representation space reveals FUCRT's ability to effectively merge unlearning class representations with the transformation class from remaining classes, closely mimicking the model retrained from scratch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。