arXiv:2606.13550cs.AIcs.CL2026-06

根据查询动态选择文档粒度,提升长文档问答的准确率

Uncertainty-Aware Hybrid Retrieval for Long-Document RAG

论文配图:Uncertainty-Aware Hybrid Retrieval for Long-Document RAG
图 1 · 摘自论文原文
  • 用不同粒度的检索器互补,按查询自适应选最佳片段
  • 融合多源结果时考虑不确定性,生成更可靠答案
  • 无需训练,可直接接入现有系统,适合长文本问答

检索增强生成(RAG)依赖于检索证据的质量与粒度。大块文档保留上下文但常引入无关内容,稀释关键信息并影响长上下文利用;细粒度片段虽紧凑,但因缺乏语义、词汇或衔接线索,难以可靠检索。本文提出无需训练的不确定性感知混合检索框架UMG-RAG,将文档粒度视为查询相关的可靠性估计。不需训练新检索器或修改生成器,UMG-RAG利用现有的稠密与稀疏检索器,在多个粒度上作为互补专家。针对每个查询,将各专家-粒度得分列表转化为证据分布,通过分布熵估计可靠性,并依据查询相关的语义、词汇和粒度置信度进行融合。进一步提出父节点促进变体UMGP-RAG,利用细粒度命中定位相关证据,同时返回更广且不冗余的父块以保证局部连贯性。在问答基准上的实验表明,不确定性感知融合与父节点促进提升了生成质量,同时保持轻量、即插即用的检索流程。

原文摘要 · Abstract (English)

Retrieval augmented generation (RAG) depends critically on the quality and granularity of retrieved evidence. Large retrieval units preserve context but often introduce irrelevant content, which can dilute answer bearing evidence and worsen long context utilization. Fine-grained units are more compact, but they may be difficult to retrieve reliably because short chunks can lack semantic, lexical, or bridging cues needed to match the query. We propose Uncertainty-aware Multi-Granularity RAG (UMG-RAG), a training-free hybrid retrieval framework that treats chunk granularity as query-specific reliability estimation. Instead of training a new retriever or modifying the generator, UMG-RAG uses existing dense and sparse retrievers as complementary experts across multiple chunk granularities. For each query, it converts each expert-granularity score list into an evidence distribution, estimates reliability from distribution entropy, and fuses candidates according to query-specific semantic, lexical, and granularity confidence. We further introduce UMGP-RAG, a parent promotion variant that uses fine-grained hits to locate relevant evidence while returning broader non-redundant parent chunks for local coherence. Experiments on question answering benchmarks show that uncertainty-aware fusion and parent promotion improve generation quality while maintaining a lightweight, plug-and-play retrieval pipeline.

RAG检索增强长文档不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。