arXiv:2606.12807cs.CL2026-06

用扩散模型精准修复摘要中过时内容,保留原有信息。

Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts

论文配图:Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts
图 1 · 摘自论文原文
  • 通过检测-重掩码-修复三步,定位并更新过时摘要片段。
  • 单次修复耗时低于0.5秒,且保持摘要完整性。
  • 适合需要快速更新、高保真度的新闻/对话摘要场景。

现实事件的摘要会随上下文演变而过时。常见做法是重新生成完整摘要,但会导致前稿丢失、难以追踪变化,且在仅少数事实失效时显得冗余。本文研究局部忠实性修复:在不改变已支持内容的前提下,仅更新过时段落。提出 DETECT-REMASK-REPAIR 框架,基于掩码扩散语言模型实现区域识别、重掩码与修复。为评估演化上下文摘要,构建 StreamSum 合成事件时间线基准。在 DialogSum 与 StreamSum 上的实验表明,局部扩散修复提供可控替代方案:基于忠实性的修复提升早期草稿质量,单步修复耗时低于半秒,实现数据集间忠实性-速度-保留度权衡。此外,该框架可作为后处理步骤,提升自回归系统摘要的忠实性。

原文摘要 · Abstract (English)

Summaries of real-world events can become outdated as contexts evolve and new information arrives. A common response is to generate a new summary from the updated context, but full regeneration discards the previous draft, can obscure what changed, and may be unnecessary when only a few claims are unsupported. We study localized faithfulness repair: updating outdated spans in an existing summary while preserving supported content. We propose DETECT-REMASK-REPAIR, a diffusion-based framework that identifies, remasks, and repairs outdated regions with masked diffusion language models. To evaluate evolving-context summarization, we introduce StreamSum, a benchmark of synthetic event timelines. Experiments on DialogSum and StreamSum show that localized diffusion repair provides a controllable alternative to full rewriting: faithfulness-steered repair improves early drafts, one-step repair reduces repair cost to under half a second, with the framework enabling faithfulness-speed-preservation tradeoffs across datasets. We also find that the framework can provide a post-hoc correction step that improves faithfulness for autoregressive systems.

摘要修复扩散模型忠实性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。