arXiv:2606.26449cs.CLcs.AI2026-06被引 1

提出可追溯生成答案证据来源的三重透明度框架,解决引用不等于影响的问题。

ProvenAI: Provenance-Native Traces of Evidence in Generated Answers

论文配图:ProvenAI: Provenance-Native Traces of Evidence in Generated Answers
图 1 · 摘自论文原文
  • 分解透明度为正确性、引用真实性和文档影响力三层次,独立测量
  • 在HotpotQA上达53.53%准确率,引用真实性均值71.55%
  • 揭示引用与实际影响脱节现象,适合可信AI与科学发现研究者

检索增强系统常在生成答案时附带引用,但引用并不意味着该来源真正影响了输出。本文提出ProvenAI框架,将多跳问答的透明度分解为三个可独立测量的层面:答案正确性、引用与基准支持证据的一致性、以及在剔除单个资源干预下的文档影响力。通过涵盖数据规范化、检索索引、引用感知生成、归因审计、基于消融的影响评估、批量评测和交互式检查的七阶段流程,对来自509,300段文本的7,405个验证样本进行评估。系统取得53.53%的答案准确率,引用真实性平均得分71.55%。一个实例揭示‘引用-影响鸿沟’:引用审计清晰,但被引用源影响微弱,而七个未引用源却显著改变输出。框架通过表面代理与标记级KL散度目标之间的形式化关系建立忠实性条件,基于因果中介分析与数据库溯源理论,并讨论其与自主科学发现中出现的密码学溯源架构的结合。ProvenAI表明,有意义的透明度需在检索到的、被引用的、行为上起作用的证据之间建立可追溯链接,且这三个层面应独立测量。

原文摘要 · Abstract (English)

Retrieval-augmented systems routinely present citations alongside generated answers, yet a citation does not confirm that the corresponding source meaningfully shaped the output. This paper introduces ProvenAI, a framework that decomposes transparency in multi-hop question answering into three independently measurable layers: answer correctness, citation fidelity against benchmark supporting evidence, and per-document influence under leave-one-resource-out intervention. Targeting the HotpotQA distractor benchmark through a seven-stage pipeline covering data normalisation, retrieval indexing, citation-aware answer generation, attribution auditing, ablation-based influence estimation, batch evaluation, and interactive inspection, ProvenAI evaluates 7,405 validation examples drawn from a canonical corpus of 509,300 passages. The system achieves 53.53% answer accuracy alongside a mean citation-fidelity score of 71.55%, and a worked example surfaces what we call the citation-influence gap: a clean citation audit co-occurring with a profile in which one cited source registers only weak influence while seven uncited sources demonstrably shift the output. We formalise the relationship between the implemented surface proxy and a token-level KL-divergence target through a stated faithfulness condition, ground the framework in causal-mediation analysis and database-provenance theory, and discuss how the three measurement layers compose with cryptographic provenance architectures emerging in autonomous scientific discovery. ProvenAI establishes that meaningful transparency in retrieval-grounded QA requires traceable links across retrieved, cited, and behaviourally influential evidence as three distinct, independently measured layers.

可解释AI溯源追踪问答系统可信生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。