提出一种无需重训即可移除特定用户数据影响的轻量级机器遗忘方法。
Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognition

- 基于模型依赖代理排序有害主体,实施轻量近似遗忘更新
- 在EngageNet和DAiSEE上实现92.5%的性能恢复,仅需四分之一重训成本
- 适合需要快速修正数据污染的场景,尤其适用于小规模审计需求
参与式情感识别数据集通常以个体为索引,且常含噪声与主观标注,导致事后数据修订成为实际问题。现有去噪与数据清洗方法多在训练前或训练中进行样本级处理,但未直接解决一个关键问题:模型训练完成后,能否在不重新训练的前提下,消除某个有问题个体的全部影响?本文通过主体级机器遗忘作为事后净化机制,研究该问题。从全样本训练的基线模型出发,利用模型依赖代理对候选有害主体进行排序,执行轻量近似遗忘更新,并与仅保留有效主体重训的基准模型(oracle)对比。在DAiSEE与EngageNet数据集上,采用固定平台TCCT-Net,在代表性K=3遗忘设置下,遗忘模型分别恢复了92.5%和89.3%的基准模型性能提升,计算成本约为重训的四分之一。在多种小规模审计场景中,效果在中等遗忘集大小时最优,表明近似主体级遗忘是低成本修正的有效手段,但其收益取决于主体选择质量与删除策略。
原文摘要 · Abstract (English)
Engagement recognition datasets are typically subject-indexed and often contain noisy, subjective supervision, making post-hoc dataset revision a practical problem. Existing noisy-label and data-cleaning methods largely operate at the sample level before or during training, but do not directly address a different question: once a model has already been trained, can the influence of an entire problematic subject be removed without full retraining? We study this setting through subject-level machine unlearning as a post-hoc sanitization mechanism for engagement recognition. Starting from a baseline trained on all subjects, we rank candidate harmful subjects using a model-dependent proxy, apply a lightweight approximate unlearning update, and compare the result against an oracle model retrained from scratch on the retained subjects only. We instantiate this protocol on DAiSEE and EngageNet using Tensor-Convolution and Convolution-Transformer Network (TCCT-Net) as a fixed platform and evaluate three matched model states under the same removal scenario: baseline, unlearned, and oracle. In representative K=3 forget-set settings, the unlearned model recovers 89.3% and 92.5% of the oracle gain on EngageNet and DAiSEE, respectively, at roughly one quarter of retraining cost. Across the tested small-audit regimes, effectiveness is strongest at an intermediate forget-set size, indicating that approximate subject-level unlearning is a useful low-cost correction mechanism, but one whose benefit depends on subject selection quality and removal regime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。