用实体幻觉指数优化摘要,让大模型少编造事实
Reducing Hallucinations in Summarization via Reinforcement Learning with Entity Hallucination Index
- 用实体幻觉指数作奖励信号,引导模型生成更真实的摘要
- 在多个数据集上显著降低实体幻觉率,且不影响流畅性和信息量
- 无需人工标注,适合大规模轻量化幻觉控制研究
抽取式摘要中的幻觉问题仍是大模型落地的关键挑战。本文提出一种基于奖励的微调框架,以实体幻觉指数(EHI)为优化目标,该指标用于量化生成摘要中命名实体的存在性、正确性与可追溯性。基于会议转录文本语料,先用预训练语言模型生成基线摘要,并通过自动实体抽取与匹配计算EHI分数。随后采用强化学习微调模型参数,以EHI作为奖励信号,引导生成更忠实于原文的实体内容。该方法无需人工编写事实性标注,支持可扩展的微调。实验显示,在多个数据集上均实现EHI的持续改善,定性分析表明实体级幻觉显著减少,且未损害流畅性与信息量。作者发布可复现的Colab流程,便于后续基于轻量级幻觉度量如EHI开展研究。
原文摘要 · Abstract (English)
Reducing hallucinations in abstractive summarization remains a critical challenge for deploying language models (LMs) in real-world settings. In this work, we introduce a rewarddriven fine-tuning framework that explicitly optimizes for Entity Hallucination Index (EHI), a metric designed to quantify the presence, correctness, and grounding of named entities in generated summaries. Given a corpus of meeting transcripts, we first generate baseline summaries using a pre-trained LM and compute EHI scores via automatic entity extraction and matching. We then apply reinforcement learning to fine-tune the model parameters, using EHI as a reward signal to bias generation toward entity-faithful outputs. Our approach does not rely on human-written factuality annotations, enabling scalable fine-tuning. Experiments demonstrate consistent improvements in EHI across datasets, with qualitative analysis revealing a significant reduction in entity-level hallucinations without degradation in fluency or informativeness. We release a reproducible Colab pipeline, facilitating further research on hallucination-aware model fine-tuning using lightweight, hallucintion metrics like EHI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。