arXiv:2607.05803cs.IR2026-07被引 1

证明了晚交互检索模型的理论优势,并提出可处理任意向量的新相似度方法。

Quantifying and Expanding the Theoretical Capacity of Late-Interaction Retrieval Models

  • 构造性证明MaxSim能精确模拟非负稀疏向量的内积,仅需O(k)空间
  • 提出Signed MaxSim可完全模拟任意实数向量内积,超越传统方法
  • 适用于带否定查询等复杂逻辑场景,适合需要强表达能力的检索系统

晚交互检索模型中使用的MaxSim相似度函数在实践中表现优异,常优于单向量密集与稀疏检索模型。然而其理论表示能力尚不明确。本文通过构造证明,MaxSim可精确复制任意非负k稀疏向量(可能无穷维)的内积,仅需O(k)表示空间;且存在某些相似度,标准向量内积在相同空间下无法表达。基于此框架,我们提出Signed MaxSim,使晚交互模型能精确模拟任意实值内积,而标准MaxSim不具备该能力。我们还证明MaxSim可作为软-或操作的聚合器,以及正合取范式逻辑表达式的评估器。理论表明,MaxSim至少与标准内积同等强大于非负向量,Signed MaxSim则对所有向量同样强大。二者均具备内积无法实现的额外能力。实验验证:在含否定查询的检索任务中,Signed MaxSim在词汇迁移下nDCG@10从0.597提升至1.000,在仅含否定的查询上从0.008提升至0.788。

原文摘要 · Abstract (English)

Late-interaction retrieval models that use the MaxSim similarity function have shown strong empirical performance, often outperforming single-vector dense and sparse retrieval models. Despite these empirical findings, little is known about the theoretical representation power of MaxSim and how it compares to other retrieval approaches. This paper shows by construction that MaxSim similarity can exactly replicate the inner product between any two non-negative k-sparse vectors with possibly infinite dimension, requiring only O(k) representation space. Moreover, there exist similarities that MaxSim can express while standard vector inner products with the same representation space cannot. Leveraging our theoretical framework, we introduce Signed MaxSim which allows late-interaction models to exactly replicate any real-valued inner product, something we prove standard MaxSim is not capable of. We also show that MaxSim can act as an aggregation of soft-OR operations and as an evaluator of logical expressions in positive Conjunctive Normal Form. Our findings show that MaxSim is at least as capable as standard vector inner products for any non-negative vectors and our extension, Signed MaxSim, is as capable for any vectors. Both similarities possess additional capabilities that inner product cannot replicate, marking one of the first theoretical justifications and quantifications of late-interaction methods. Our theoretical findings are supported empirically: on a retrieval task featuring queries with negations, Signed MaxSim improves out-of-domain performance significantly over a standard ColBERT/MaxSim baseline with nDCG@10 increasing from 0.597 to 1.000 under a vocabulary shift and from 0.008 to 0.788 on negation-only queries.

检索模型理论分析向量表示符号化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。