arXiv:2507.19715cs.LG2025-07

用语义压缩与图增强提升向量检索的多样性与上下文覆盖能力

Beyond Nearest Neighbors: Semantic Compression and Graph-Augmented Retrieval for Enhanced Vector Search

  • 通过子模优化与信息几何设计语义压缩策略,提升检索多样性
  • 在高维空间中证明邻近检索存在语义冗余,图结构可显著改善覆盖范围
  • 适合需要多跳推理和丰富上下文的RAG、多跳问答等应用

向量数据库通常依赖近似最近邻(ANN)搜索,在嵌入空间中为查询检索最接近的前k个向量。尽管有效,该方法常导致语义重复的结果,难以满足检索增强生成(RAG)、多跳问答和记忆增强智能体等应用对多样性和上下文丰富性的需求。本文提出一种新的检索范式:语义压缩,旨在选取一组紧凑且具有代表性的向量,以捕捉查询周围的更广泛语义结构。我们基于子模优化和信息几何原则形式化该目标,并证明其可泛化传统top-k检索,优先考虑覆盖度与多样性。为实现此理念,提出图增强向量检索,将语义图(如kNN或基于知识的链接)叠加于向量空间之上,支持多跳、上下文感知的搜索。我们理论分析了高维集中性下基于距离的检索局限,并说明图结构如何提升语义覆盖。本工作为以意义为中心的向量检索系统奠定了基础,强调混合索引、多样性感知查询与结构化语义检索。代码已公开,以促进该领域研究。

原文摘要 · Abstract (English)

Vector databases typically rely on approximate nearest neighbor (ANN) search to retrieve the top-k closest vectors to a query in embedding space. While effective, this approach often yields semantically redundant results, missing the diversity and contextual richness required by applications such as retrieval-augmented generation (RAG), multi-hop QA, and memory-augmented agents. We introduce a new retrieval paradigm: semantic compression, which aims to select a compact, representative set of vectors that captures the broader semantic structure around a query. We formalize this objective using principles from submodular optimization and information geometry, and show that it generalizes traditional top-k retrieval by prioritizing coverage and diversity. To operationalize this idea, we propose graph-augmented vector retrieval, which overlays semantic graphs (e.g., kNN or knowledge-based links) atop vector spaces to enable multi-hop, context-aware search. We theoretically analyze the limitations of proximity-based retrieval under high-dimensional concentration and highlight how graph structures can improve semantic coverage. Our work outlines a foundation for meaning-centric vector search systems, emphasizing hybrid indexing, diversity-aware querying, and structured semantic retrieval. We make our implementation publicly available to foster future research in this area.

向量检索语义压缩图增强RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。