arXiv:2603.18011cs.CLcs.IR2026-03

提出无需训练的确定性证据筛选框架,提升问答系统可解释性。

Controllable Evidence Selection in Retrieval-Augmented Question Answering via Deterministic Utility Gating

  • 通过语义相关、术语覆盖等信号独立评估每条文本
  • 只保留能独立满足任务条件的证据,拒绝冗余或不完整内容
  • 适合需要高可信度和可审计性的专业问答场景

当前多数AI问答系统通过向量相似度检索文本,但仅靠相似度无法判断哪些文本可作为有效证据。当多个候选文本得分相近时,系统可能选出冗余、不完整或不匹配问题条件的内容。本文提出一种无需训练的确定性证据选择框架,引入意义-效用估计(MUE)和多样性-效用估计(DUE),在生成答案前对每个句子或记录进行独立评估,依据语义相关性、术语覆盖、概念独特性和冗余度等显式信号判断其是否符合证据标准。只有明确陈述任务所需事实、规则或条件的单元才被接受,且不合并或扩展内容。若无单元能独立满足要求,则不返回答案。该方法生成紧凑且可审计的证据集,清晰界定相关文本与可用证据之间的边界。

原文摘要 · Abstract (English)

Many modern AI question-answering systems convert text into vectors and retrieve the closest matches to a user question. While effective for topical similarity, similarity scores alone do not explain why some retrieved text can serve as evidence while other equally similar text cannot. When many candidates receive similar scores, systems may select sentences that are redundant, incomplete, or address different conditions than the question requires. This paper presents a deterministic evidence selection framework for retrieval-augmented question answering. The approach introduces Meaning-Utility Estimation (MUE) and Diversity-Utility Estimation (DUE), fixed scoring and redundancy-control procedures that determine evidence admissibility prior to answer generation. Each sentence or record is evaluated independently using explicit signals for semantic relatedness, term coverage, conceptual distinctiveness, and redundancy. No training or fine-tuning is required. In the prototype, a unit is accepted only if it explicitly states the fact, rule, or condition required by the task. Units are not merged or expanded. If no unit independently satisfies the requirement, the system returns no answer. This deterministic gating produces compact, auditable evidence sets and establishes a clear boundary between relevant text and usable evidence.

问答系统证据筛选可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。