通过多粒度索引与置信度约束,提升复杂场景下RAG的准确性和可靠性。
LLM-Centric RAG with Multi-Granular Indexing and Confidence Constraints
- 构建分层记忆结构,实现从细节到上下文的动态检索
- 引入不确定性估计,过滤低置信路径,减少错误信息
- 在问答、召回、一致性上均优于现有方法,适合高可靠性场景
本文针对复杂知识环境下检索增强生成存在的覆盖不足、结果不稳定和可靠性有限等问题,提出一种融合多粒度记忆索引与不确定性估计的置信度控制方法。该方法构建分层记忆结构,将知识表示按不同粒度划分,支持从局部细节到全局上下文的动态索引与检索,强化了检索与生成之间的语义关联。在此基础上,引入不确定性估计机制,在生成过程中显式约束并过滤低置信路径,使模型在保持信息覆盖率的同时有效抑制噪声与虚假内容。整体优化目标包含生成损失、熵约束与方差正则化,形成统一的置信度控制框架。实验设计涵盖超参数、环境条件与数据结构的全面敏感性测试与对比分析,验证了方法在不同场景下的稳定性与鲁棒性。结果表明,该方法在问答准确率、检索召回率、排序质量与事实一致性上均优于现有模型,证明了多粒度索引与置信度控制结合的有效性。本研究不仅为检索增强生成提供了新路径,也为大模型在复杂场景下的可靠性与可控性提供了实践依据。
原文摘要 · Abstract (English)
This paper addresses the issues of insufficient coverage, unstable results, and limited reliability in retrieval-augmented generation under complex knowledge environments, and proposes a confidence control method that integrates multi-granularity memory indexing with uncertainty estimation. The method builds a hierarchical memory structure that divides knowledge representations into different levels of granularity, enabling dynamic indexing and retrieval from local details to global context, and thus establishing closer semantic connections between retrieval and generation. On this basis, an uncertainty estimation mechanism is introduced to explicitly constrain and filter low-confidence paths during the generation process, allowing the model to maintain information coverage while effectively suppressing noise and false content. The overall optimization objective consists of generation loss, entropy constraints, and variance regularization, forming a unified confidence control framework. In the experiments, comprehensive sensitivity tests and comparative analyses were designed, covering hyperparameters, environmental conditions, and data structures, to verify the stability and robustness of the proposed method across different scenarios. The results show that the method achieves superior performance over existing models in QA accuracy, retrieval recall, ranking quality, and factual consistency, demonstrating the effectiveness of combining multi-granularity indexing with confidence control. This study not only provides a new technical pathway for retrieval-augmented generation but also offers practical evidence for improving the reliability and controllability of large models in complex contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。