让大模型生成的内容可追溯可验证,提升事实可靠性。
Trust but Verify: Introducing DAVinCI -- A Framework for Dual Attribution and Verification in Claim Inference for Language Models

- 双阶段框架:先追踪说法来源,再用逻辑推理验证真伪。
- 在多个数据集上准确率和召回率提升5%至20%。
- 适合需要高可信度的医疗、法律等关键领域使用。
大型语言模型虽在多种自然语言任务中表现流畅多样,但常出现事实错误与幻觉,尤其在医疗、法律及科学传播等高风险领域带来严重隐患。本文提出DAVinCI——一种双溯源与验证框架,以增强模型输出的事实可靠性与可解释性。该框架分两步运行:(i) 将生成的主张归因于模型内部组件或外部来源;(ii) 通过蕴含推理与置信度校准对每条主张进行验证。我们在FEVER与CLIMATE-FEVER等多个数据集上评估了DAVinCI,并与仅验证的基线方法对比。结果表明,其分类准确率、溯源精度、召回率及F1分数均提升5%至20%。通过系统性消融实验,我们识别出证据片段选择、重校准阈值与检索质量的关键贡献。我们还开源了模块化DAVinCI实现,可无缝集成至现有大模型流程。通过融合溯源与验证,DAVinCI为构建可审计、可信的人工智能系统提供了可扩展路径。本工作推动大模型不仅强大,更可问责。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across a wide range of NLP tasks, yet they remain prone to factual inaccuracies and hallucinations. This limitation poses significant risks in high-stakes domains such as healthcare, law, and scientific communication, where trust and verifiability are paramount. In this paper, we introduce DAVinCI - a Dual Attribution and Verification framework designed to enhance the factual reliability and interpretability of LLM outputs. DAVinCI operates in two stages: (i) it attributes generated claims to internal model components and external sources; (ii) it verifies each claim using entailment-based reasoning and confidence calibration. We evaluate DAVinCI across multiple datasets, including FEVER and CLIMATE-FEVER, and compare its performance against standard verification-only baselines. Our results show that DAVinCI significantly improves classification accuracy, attribution precision, recall, and F1-score by 5-20%. Through an extensive ablation study, we isolate the contributions of evidence span selection, recalibration thresholds, and retrieval quality. We also release a modular DAVinCI implementation that can be integrated into existing LLM pipelines. By bridging attribution and verification, DAVinCI offers a scalable path to auditable, trustworthy AI systems. This work contributes to the growing effort to make LLMs not only powerful but also accountable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。