无需保留数据,通过探测与编辑实现工业物联网模型高效删忆。
Probing then Editing: A Push-Pull Framework for Retain-Free Machine Unlearning in Industrial IoT
- 先探测目标类决策边界,生成编辑指令,再分推拉两路优化。
- 在CWRU和SCUT-FD等数据集上兼顾遗忘效果与模型性能。
- 适合数据隐私严苛、无保留数据的工业场景使用。
在动态的工业互联网(IIoT)环境中,模型需具备选择性遗忘过时或错误知识的能力。然而,现有方法通常依赖保留数据来约束模型行为,增加了计算与能耗负担,并与工业数据孤岛及隐私合规要求冲突。为此,我们提出一种新型无保留数据遗忘框架——探测后编辑(PTE)。PTE将遗忘过程建模为探测-编辑流程:首先通过梯度上升探测待遗忘类别的决策边界邻域,利用模型自身预测生成编辑指令;随后进行推-拉协同优化:推分支利用编辑指令主动瓦解目标类别的决策区域,拉分支则采用掩码知识蒸馏,将保留类别的知识锚定在原始状态。得益于该机制,PTE仅需待遗忘数据与原始模型即可实现高效且均衡的知识编辑。实验表明,PTE在多个通用与工业基准(如CWRU和SCUT-FD)上均实现了遗忘效果与模型效用的良好平衡。
原文摘要 · Abstract (English)
In dynamic Industrial Internet of Things (IIoT) environments, models need the ability to selectively forget outdated or erroneous knowledge. However, existing methods typically rely on retain data to constrain model behavior, which increases computational and energy burdens and conflicts with industrial data silos and privacy compliance requirements. To address this, we propose a novel retain-free unlearning framework, referred to as Probing then Editing (PTE). PTE frames unlearning as a probe-edit process: first, it probes the decision boundary neighborhood of the model on the to-be-forgotten class via gradient ascent and generates corresponding editing instructions using the model's own predictions. Subsequently, a push-pull collaborative optimization is performed: the push branch actively dismantles the decision region of the target class using the editing instructions, while the pull branch applies masked knowledge distillation to anchor the model's knowledge on retained classes to their original states. Benefiting from this mechanism, PTE achieves efficient and balanced knowledge editing using only the to-be-forgotten data and the original model. Experimental results demonstrate that PTE achieves an excellent balance between unlearning effectiveness and model utility across multiple general and industrial benchmarks such as CWRU and SCUT-FD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。