arXiv:2411.08562cs.IRcs.AI2024-11被引 1

让神经检索模型删数据不丢性能,还能隐藏删除痕迹。

Neural Corrective Machine Unranking

  • 用替代文档替换要删除的数据,保持排名不变。
  • 在1%到20%删数据下,效果优于7个顶尖方法。
  • 适合需要合规删除、又怕影响搜索体验的系统。

神经信息检索系统中的机器遗忘需移除特定数据同时保持性能。现有方法在检索场景中可能降低召回效果或暴露删除行为。本文提出校正性重排序(Corrective Unranking),通过引入替代文档维持排序完整性,并设计教师-学生框架CuRD实现该任务:(1) 调整模型输出,使待遗忘样本的相关性分数趋近于低排名不可见样本;(2) 微调替代样本的相关性分数,使其与原样本高度匹配;(3) 保持非目标样本的性能。在四个神经检索模型(BERTcat, BERTdot, ColBERT, PARADE)上使用MS MARCO和TREC CAR数据集验证,实验覆盖1%至20%的遗忘比例,结果表明CuRD在遗忘效率与修复能力上超越7个先进基线,同时维持模型保留与泛化能力。

原文摘要 · Abstract (English)

Machine unlearning in neural information retrieval (IR) systems requires removing specific data whilst maintaining model performance. Applying existing machine unlearning methods to IR may compromise retrieval effectiveness or inadvertently expose unlearning actions due to the removal of particular items from the retrieved results presented to users. We formalise corrective unranking, which extends machine unlearning in (neural) IR context by integrating substitute documents to preserve ranking integrity, and propose a novel teacher-student framework, Corrective unRanking Distillation (CuRD), for this task. CuRD (1) facilitates forgetting by adjusting the (trained) neural IR model such that its output relevance scores of to-be-forgotten samples mimic those of low-ranking, non-retrievable samples; (2) enables correction by fine-tuning the relevance scores for the substitute samples to match those of corresponding to-be-forgotten samples closely; (3) seeks to preserve performance on samples that are not targeted for forgetting. We evaluate CuRD on four neural IR models (BERTcat, BERTdot, ColBERT, PARADE) using MS MARCO and TREC CAR datasets. Experiments with forget set sizes from 1 % and 20 % of the training dataset demonstrate that CuRD outperforms seven state-of-the-art baselines in terms of forgetting and correction while maintaining model retention and generalisation capabilities.

机器遗忘信息检索神经模型数据合规

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。