arXiv:2609.06786cs.LG2026-09

解决表格数据遗忘时保留与遗忘的冲突问题

When Retain Constraints Conflict: Mitigating Forget-Retain Interference in Tabular Data

论文配图:When Retain Constraints Conflict: Mitigating Forget-Retain Interference in Tabular Data
图 1 · 摘自论文原文
  • 提出感知模式冲突的遗忘方法,动态放松冲突样本的保留约束
  • 在临床与非医疗表格任务中逼近重训练基准,保持模型性能
  • 适合高风险领域中需精准数据删除的表格大模型应用

机器遗忘旨在移除指定训练数据的影响,同时保持模型效用,但其在表格数据上的表现仍缺乏研究。这一空白至关重要,因为表格预测广泛应用于高风险领域,并正通过记录序列化和模式感知提示适配语言模型。我们识别出表格遗忘区别于自由文本或其他模态的关键挑战:模式引发的遗忘-保留重叠。在序列化表格数据中,记录共享固定列名/值槽位、相似属性范围和共同输出空间,导致待遗忘行可能邻近依赖相同高信号属性的保留行,使保留与遗忘需求产生冲突。针对此失效模式,我们提出冲突感知遗忘(CAU),一种模式感知方法,通过放松与遗忘集最冲突的保留行的保留约束,减少遗忘-保留干扰。在临床与非医疗表格任务的样本级与特征级遗忘实验中,CAU更接近重训练基准,同时保持预测效用和保留区域行为。结果表明,可靠表格大模型遗忘不仅取决于遗忘目标,也取决于保留约束的构建方式。

原文摘要 · Abstract (English)

Machine unlearning aims to remove the influence of designated training data while preserving model utility, but its behavior on tabular data remains underexplored. This gap is important because tabular prediction is widely used in high-stakes domains and is increasingly adapted to language models through record serialization and schema-aware prompting. We identify a key challenge that distinguishes tabular unlearning from unlearning in free-form text or other modalities: schema-induced forget-retain overlap. In serialized tabular data, records share fixed column-name/value slots, similar attribute ranges, and common output spaces. Consequently, a forget row may have nearby retain rows that rely on the same high-signal attributes, causing retain preservation to oppose the update required for forgetting. Motivated by this failure mode, we propose Conflict-Aware Unlearning (CAU), a schema-aware approach that reduces forget-retain interference by relaxing preservation constraints on retained rows that most conflict with the forget set. Across sample-level and feature-level unlearning on clinical and non-medical tabular tasks, CAU more closely matches a retraining oracle while maintaining predictive utility and retain-region behavior. Our results show that reliable tabular LLM unlearning depends not only on the forgetting objective, but also on how retain constraints are constructed.

机器遗忘表格数据大模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。