arXiv:2511.09980cs.CL2025-11AAAI被引 11

通过分析不确定性的变化趋势,提前触发检索,提升动态RAG的响应速度与准确性。

Modeling Uncertainty Trends for Timely Retrieval in Dynamic RAG

  • 基于熵的变化趋势判断何时检索,而非仅看当前置信度。
  • 在6个问答数据集上优于主流方法,检索次数减少20%以上。
  • 无需训练、可直接接入现有模型,适合需要快速响应的场景。

动态检索增强生成(Dynamic RAG)允许大语言模型按需获取外部知识,比静态RAG更具适应性。其核心挑战在于确定最优检索时机。现有方法通常依据低分词级置信度触发检索,可能导致错误传播后才干预。本文提出熵趋势约束(ETC),一种无需训练的方法,通过建模分词级不确定性动态变化来确定最佳检索时机。具体而言,ETC利用熵序列的一阶与二阶差分检测不确定性上升趋势,实现更早、更精准的检索。在三个LLM主干和六个QA基准上的实验表明,ETC持续优于强基线,同时降低检索频率。在领域特定场景中表现尤为突出,具备良好泛化能力。消融实验与定性分析进一步验证了趋势感知的不确定性建模能带来更有效的检索时机。该方法为即插即用、模型无关,可轻松集成至现有解码流程。实现代码已附于补充材料。

原文摘要 · Abstract (English)

Dynamic retrieval-augmented generation (RAG) allows large language models (LLMs) to fetch external knowledge on demand, offering greater adaptability than static RAG. A central challenge in this setting lies in determining the optimal timing for retrieval. Existing methods often trigger retrieval based on low token-level confidence, which may lead to delayed intervention after errors have already propagated. We introduce Entropy-Trend Constraint (ETC), a training-free method that determines optimal retrieval timing by modeling the dynamics of token-level uncertainty. Specifically, ETC utilizes first- and second-order differences of the entropy sequence to detect emerging uncertainty trends, enabling earlier and more precise retrieval. Experiments on six QA benchmarks with three LLM backbones demonstrate that ETC consistently outperforms strong baselines while reducing retrieval frequency. ETC is particularly effective in domain-specific scenarios, exhibiting robust generalization capabilities. Ablation studies and qualitative analyses further confirm that trend-aware uncertainty modeling yields more effective retrieval timing. The method is plug-and-play, model-agnostic, and readily integrable into existing decoding pipelines. Implementation code is included in the supplementary materials.

动态RAG检索优化不确定性建模LLM推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。