arXiv:2606.26036cs.CLcs.CR2026-06

提出防御文本摘要模型训练阶段数据投毒的新方法,可检测并修复被污染的模型。

Detect, Unlearn, Restore: Defending Text Summarization Models Against Data Poisoning

论文配图:Detect, Unlearn, Restore: Defending Text Summarization Models Against Data Poisoning
图 1 · 摘自论文原文
  • 通过影响函数与语义一致性检查,识别训练中异常高影响的数据对。
  • 在黑盒场景下,中毒模型对语义扰动更敏感,检测精度达85%-92%。
  • 可恢复96%原始性能,适合部署后安全检测与模型修复场景。

在大语言模型进行抽象式文本摘要任务的微调过程中,训练数据投毒构成重大威胁。攻击者通过操纵微调数据,诱导模型生成带有偏见或有害的摘要,同时保持标准评估指标正常。本文提出统一的后置防御框架,可在整个机器学习供应链中检测并修复摘要模型在微调阶段受到的投毒攻击。实验表明,在白盒设置下,中毒的数据-摘要对表现出异常高的训练影响度,可通过影响函数分析结合语义一致性验证实现检测;在黑盒设置下,中毒模型对保留语义的扰动敏感度提升2至3倍,支持无需访问训练数据的行为审计。我们还引入针对事实扭曲和表征偏见的新攻击类型,发现投毒会改变摘要行为却不触发传统警报。在九种架构、六个基准数据集上,面对自适应攻击,该防御方案检测精度达85%-92%,梯度上升去学习可恢复高达96%的原始行为,仅导致小于0.6%的ROUGE得分下降。结果表明,微调阶段的投毒会在模型中留下持久结构痕迹,支持实际检测与部署后恢复,无需完全重训。

原文摘要 · Abstract (English)

Training-time data poisoning during fine-tuning poses a significant threat to large language models (LLMs) deployed for abstractive text summarization, where small task-specific datasets exert disproportionate influence on model behavior. In this setting, adversaries manipulate fine-tuning data to induce persistent summarization failures, such as biased or harmful summaries, while preserving standard evaluation metrics. We present a unified post-hoc defense framework for detecting and remediating fine-tuning-stage poisoning in summarization models across the machine learning supply chain. Our experiments show that in white-box settings, poisoned document-summary pairs exhibit abnormally high training influence, enabling detection via influence-function analysis with semantic consistency checks. In black-box settings, poisoned models display two to three times greater sensitivity to semantics-preserving perturbations, enabling behavioral auditing without training data access. Beyond existing poisoning formulations, we introduce novel attacks targeting factual distortion and representational bias, showing that poisoning alters summarization behavior without triggering conventional alarms. Across nine architectures and six benchmark datasets under adaptive attacks, our defenses achieve 85-92% detection precision, while gradient-ascent unlearning restores up to 96% of original behavior with minimal utility loss (less than 0.6% ROUGE degradation). These results indicate that fine-tuning-time poisoning leaves persistent structural artifacts, enabling practical detection and post-deployment recovery without full retraining.

数据投毒摘要模型模型安全后置防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。