arXiv:2512.05387cs.CL2025-12被引 2

让大模型自己批评并改进摘要,提升准确性。

Learning from Self Critique and Refinement for Faithful LLM Summarization

  • 用模型自身生成批评与修正内容构建偏好数据集
  • 在三个基准上忠实度显著提升,质量不下降
  • 无需额外计算资源,适合实际部署

大语言模型在长文本摘要任务中常产生与原文无关的幻觉内容。已有方法通过迭代式批评与修正来减少幻觉,但需额外推理计算或依赖更强教师模型,成本高且不实用。本文提出自评与修正偏好优化(SCRPO),一种自监督训练框架:先利用模型自身能力构建偏好数据集,再通过偏好学习优化同一模型,使其更忠实于输入。在XSUM、CNNDM和SAMSum三个摘要基准上的实验表明,该方法在忠实度指标上优于现有自监督方法,同时保持甚至提升了摘要整体质量。相比测试时修正,本方法效率更高且生成更忠实的摘要。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often suffer from hallucinations: output content that is not grounded in the input context, when performing long-form text generation tasks such as summarization. Prior works have shown that hallucinations can be reduced by iteratively critiquing and refining previously generated outputs using either the same model or a more powerful teacher model as the critique. However, these approaches either require additional test-time compute or assume access to more powerful teacher models, making them costly and less practical. In this work, we propose Self Critique and Refinement-based Preference Optimization (SCRPO), which is a self-supervised training framework that first constructs a preference dataset by leveraging the LLM's own critique and refinement capabilities, and then applies preference learning to improve the same LLM for faithful summarization. Experiments on three summarization benchmarks (XSUM CNNDM and SAMSum), demonstrate that our approach outperforms state-of-the-art self-supervised learning methods in terms of faithfulness metrics while either maintaining or improving other metrics that measure the overall quality of the summary. Moreover, compared to test-time refinement, our approach not only improves efficiency but also results in more faithful summaries.

大模型摘要生成幻觉抑制自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。