arXiv:2606.12897cs.CL2026-06

用提取代替重写,提升安全关键场景下文档问答的准确性和可靠性。

SafeLLM: Extraction as a Hallucination-Resistant Alternative to Rewriting in Safety-Critical Settings

论文配图:SafeLLM: Extraction as a Hallucination-Resistant Alternative to Rewriting in Safety-Critical Settings
图 1 · 摘自论文原文
  • 采用基于行号的原文片段提取,避免自由重写带来的幻觉。
  • 在小模型上实现最高95%的术语召回率,大模型上接近原文对齐。
  • 适合医疗、合规等需高精度的敏感领域使用。

大型语言模型(LLM)越来越多地用于访问组织文档,如标准操作流程(SOP)、人力资源政策和机构指南。然而,依赖自由重写的检索增强生成(RAG)系统在安全与合规关键场景中易引入幻觉,并在完整性与简洁性之间产生不稳定的权衡。本文评估了提取作为重写替代方案的抗幻觉能力,比较了多种提示策略,包括基于行号的源文档选择、带显式安全标注的指南句提取,以及利用源指南支持证据分阶段优化答案的多阶段流程。实验涵盖不同长度与结构的文档,包括英国国家卫生与临床优化研究所(NICE)指南和本地急症护理及肿瘤学指南,使用前沿规模与本地可部署模型进行测试。性能通过自动指标与人类专家对相关性与完整性的评估进行衡量。结果表明,行号选择策略在大小模型上均表现最佳,优于直接复制与安全导向策略,同时保持高达95%的术语召回率并紧密贴合原文;安全导向方法虽提高精确率但导致系统性遗漏,多阶段过滤进一步加剧该权衡。文档结构影响性能:行提取在协议类内容中表现优异,而其他策略在更冗长文档中表现更佳(最高达97%术语召回率)。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used to access organisational documentation, including standard operating procedures (SOPs), HR policies and institutional guidelines. However, retrieval-augmented generation (RAG) systems that rely on free-form rewriting can introduce hallucinations and unstable trade-offs between completeness and conciseness, particularly in safety- and compliance-critical settings. Objectives: To evaluate extraction as a hallucination-resistant alternative to rewriting-based RAG and compare strategies that balance precision, recall and safety across document types and model scales. Methods: We compare multiple prompting strategies, including line-number-based source selection, extraction of relevant guideline sentences with explicit safety annotations, and a multi-stage pipeline that refines draft answers using supporting evidence from source guidelines. Experiments are conducted on documents of varying length and structure, including local NHS acute care and oncology guidelines and UK-wide NICE guidelines, using both frontier-scale and locally deployable models. Performance is assessed using automatic metrics and human expert evaluation of relevance and completeness. Results: Line-number selection achieves the strongest results, outperforming direct copying and safety-focused strategies across both large and small models while maintaining high term recall (up to 95%) and close alignment with source text. Safety-oriented approaches improve precision but introduce systematic omissions, while multi-stage filtering further amplifies this trade-off. Performance varies with document structure: line-based extraction excels in protocol-like content, whereas alternative strategies perform better on more verbose documents (up to 97% term recall).

LLM安全文档问答幻觉抑制医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。