让AI识别事实冲突是自然演变还是恶意篡改,提升问答可靠性
EvoTrustRAG: Evolution-Aware Conflict Attribution and Evidence Handling for Reliable Retrieval-Augmented Generation

- 构建冲突证据图,用时间与支持结构判断冲突来源
- 在基准测试中准确率81.4%,对抗攻击下错误率降至16.0%
- 无需训练,适合需要高可信度的动态知识场景
检索增强生成(RAG)通过外部知识提升大模型的事实准确性,但在动态和对抗环境中,冲突信息仍是根本挑战。现有方法常将冲突视为静态不一致并选择更可靠知识,却忽视同一冲突可能源于合法的知识演进、恶意操纵或未解不确定性。本文首次将冲突成因归因建模为RAG中的新问题:基于可观察上下文判断哪种解释更合理,而非仅决定应信任哪个事实。提出EvoTrustRAG——一种无需训练的演化感知冲突归因与证据处理框架。该框架将片段锚定的检索事实表示为冲突证据图,利用时间关系、支持结构与辅助一致性评估演化与定向干预假设,并将局部决策投影至全局一致的冲突组解释。归因结果决定早期/后期状态是否保留为时序知识、干预项是否分离主上下文,或冲突是否仍对生成器可见。不同于聚焦事后分析的溯源方法,EvoTrustRAG在推理阶段判断冲突是否符合合理知识演化、呈现干预特征或无法可靠归因。实验表明,EvoTrustRAG在基准原生冲突设置下平均准确率达81.4%,归因宏F1从72.2%提升至79.1%,最强协同攻击下的错误率由31.2%降至16.0%。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) improves the factuality of large language models with external knowledge, yet conflicting evidence remains a fundamental challenge in dynamic and adversarial environments. Existing approaches often treat conflicts as static inconsistencies and select more reliable knowledge, overlooking that the same conflict may arise from legitimate knowledge evolution, malicious manipulation, or unresolved uncertainty. We formulate conflict origin attribution as a new problem in RAG: identifying which explanation of conflicting evidence is supported by observable context rather than simply which fact should be trusted. We propose EvoTrustRAG, a training-free framework for evolution-aware conflict attribution and evidence handling before answer generation. EvoTrustRAG represents span-grounded retrieved facts as a conflict evidence graph, evaluates grounded evolution and directional intervention hypotheses using temporal relations, support structure, and auxiliary consistency, and projects local decisions onto a globally consistent explanation of each conflict group. The attribution determines whether earlier and later states are preserved as temporal knowledge, an intervention candidate is separated from the primary context, or an unresolved conflict remains visible to the generator. Unlike provenance-based approaches focused on post-hoc analysis, EvoTrustRAG determines during inference whether conflicting evidence follows plausible knowledge evolution, exhibits intervention-like support, or cannot be reliably attributed. Experiments show that EvoTrustRAG achieves 81.4% average accuracy on benchmark-native conflict settings, improves attribution macro-F1 from 72.2% to 79.1% over the strongest baseline, and reduces the error rate under the strongest coordinated attack from 31.2% to 16.0%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。