arXiv:2502.19785cs.CRcs.LG2025-02被引 10

提出新方法让语义通信模型安全删除用户数据,兼顾隐私与性能。

SCU: An Efficient Machine Unlearning Scheme for Deep Learning Enabled Semantic Communications

  • 通过最小化语义表示与被删数据的互信息实现联合编解码器去学习。
  • 在三个数据集上验证,去学习后模型准确率下降不超过5.2%。
  • 适合关注隐私保护的语义通信系统研发者使用。

深度学习赋能的语义通信利用深度学习训练编码器和解码器(代码器)以提取和恢复语义信息。然而,多数语义训练数据包含个人隐私信息,当旧用户希望从语义系统中移除其数据时,需满足严格的数据擦除要求。现有机器去学习方案通常仅适用于监督场景下的单一模型,难以应用于需要联合训练无监督编码器与解码器的语义通信系统。本文研究深度学习语义通信中的去学习问题,提出一种语义通信去学习(SCU)方案。SCU包含两个核心组件:首先,针对语义代码器(编码器与解码器)定制联合去学习方法,通过最小化学习到的语义表示与被擦除样本之间的互信息;其次,为补偿去学习导致的模型性能下降,提出对比补偿方法,将被擦除数据视为负样本,剩余数据视为正样本,对去学习后的语义模型进行对比重训练。理论分析与在三个代表性数据集上的大量实验结果表明,所提方法在有效性和效率上均表现优异。

原文摘要 · Abstract (English)

Deep learning (DL) enabled semantic communications leverage DL to train encoders and decoders (codecs) to extract and recover semantic information. However, most semantic training datasets contain personal private information. Such concerns call for enormous requirements for specified data erasure from semantic codecs when previous users hope to move their data from the semantic system. {Existing machine unlearning solutions remove data contribution from trained models, yet usually in supervised sole model scenarios. These methods are infeasible in semantic communications that often need to jointly train unsupervised encoders and decoders.} In this paper, we investigate the unlearning problem in DL-enabled semantic communications and propose a semantic communication unlearning (SCU) scheme to tackle the problem. {SCU includes two key components. Firstly,} we customize the joint unlearning method for semantic codecs, including the encoder and decoder, by minimizing mutual information between the learned semantic representation and the erased samples. {Secondly,} to compensate for semantic model utility degradation caused by unlearning, we propose a contrastive compensation method, which considers the erased data as the negative samples and the remaining data as the positive samples to retrain the unlearned semantic models contrastively. Theoretical analysis and extensive experimental results on three representative datasets demonstrate the effectiveness and efficiency of our proposed methods.

机器去学习语义通信隐私保护对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。