arXiv:2604.03240cs.LGcs.AI2026-04被引 1

让检索更准:同时兼顾信息密度与多样性

Scaling DPPs for RAG: Density Meets Diversity

论文配图:Scaling DPPs for RAG: Density Meets Diversity
图 1 · 摘自论文原文
  • 用轻量适配器引入确定性点过程,建模文档块间互补关系
  • 在多个数据集上提升检索质量,优于传统相关性排序方法
  • 适合需要高精度、少冗余的生成式问答系统使用

检索增强生成(RAG)通过外部知识库提升大语言模型的表现,使生成内容既符合事实又随语料更新。标准RAG流程仅对查询与每个文档块做独立打分,忽略候选项间的相互作用,导致上下文重复,信息密度下降,难以发现互补证据。本文提出ScalDPP,一种面向RAG的多样性感知检索机制,通过轻量级P-Adapter引入确定性点过程(DPP),实现文档块间依赖关系的高效建模与互补上下文选择。同时设计新的集合级损失函数——多样边际损失(DML),确保真实互补证据链在DPP几何结构下优于同等规模的冗余组合。实验验证了ScalDPP的有效性,实证支持其核心主张。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding generation in external knowledge, yielding relevance responses that are aligned with factual evidence and evolving corpora. Standard RAG pipelines construct context through relevance ranking, performing point-wise scoring between the user query and each corpora chunk. This formulation, however, ignores interactions among retrieved candidates, leading to redundant contexts that dilute density and fail to surface complementary evidence. We argue that effective retrieval should optimize jointly for both density and diversity, ensuring the grounding evidence that is dense in information yet diverse in coverage. In this study, we propose ScalDPP, a diversity-aware retrieval mechanism for RAG that incorporates Determinantal Point Processes (DPPs) through a lightweight P-Adapter, enabling scalable modeling of inter-chunk dependencies and complementary context selection. In addition, we develop a novel set-level objective, Diverse Margin Loss (DML), that enforces ground-truth complementary evidence chains to dominate any equally sized redundant alternatives under DPP geometry. Experimental results demonstrate the superiority of ScalDPP, substantiating our core statement in practice.

RAG检索增强多样性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。