arXiv:2602.02827cs.IR2026-02

提出高效估算检索结果前K名的方法,显著降低计算量。

Col-Bandit: Query-Time Top-$K$ Estimation for Late-Interaction Retrieval

  • 按批次查询矩阵元素,动态剪枝低分文档
  • 在保持90%以上准确率下减少8倍计算量
  • 无需重训练,可直接替换现有检索模块

多向量晚交互检索器如ColBERT虽性能领先,但查询时需全量计算每篇候选文档与查询词的逐项最大相似度(MaxSim),开销巨大。该矩阵为N×T,行和即为最终得分,而前K名往往无需全部计算。本文提出Col-Bandit,在查询时通过批量揭示矩阵元素,对每个候选文档维护有限总体伯恩斯坦-塞夫林置信区间,并永久剔除上界低于第K名下界的文档,仅计算必要单元以区分前K名。一个松弛参数α_{ef}∈(0,1]调控计算与精度权衡:当α_{ef}=0.2时,在BEIR和REAL-MM-RAG数据集上,对所有语料库均保持≥90%的前5名保真度,同时将MaxSim FLOPs降低约8倍,单线程CPU速度提升最高达13倍(x86与ARM平台)。该方法为即插即用的重排序层,无需重新训练或修改索引。

原文摘要 · Abstract (English)

Multi-vector late-interaction retrievers such as ColBERT achieve state-of-the-art quality, but their query-time cost is dominated by exhaustively computing token-level MaxSim interactions for every candidate document. The MaxSim scores of $N$ candidates against $T$ query tokens form an $N\times T$ matrix whose row-sums are the late-interaction scores, and identifying the top-$K$ rarely requires every entry. We introduce Col-Bandit, a query-time estimator of the exhaustive-MaxSim top-$K$: it reveals matrix entries in batches, maintains a finite-population Bernstein-Serfling confidence interval on each candidate's score, and permanently drops any document whose upper bound falls below the $K$-th largest lower bound, computing only the cells needed to separate the top-$K$. A single relaxation knob $α_{\mathrm{ef}}\in(0,1]$ tunes the compute-fidelity trade-off. We deploy $α_{\mathrm{ef}}{=}0.2$, while $α_{\mathrm{ef}}{=}1$ admits a $δ$-PAC guarantee under a simplified radius. On BEIR and REAL-MM-RAG, Col-Bandit preserves $\geq 90\%$ fidelity to the exhaustive top-$5$ on every corpus while cutting MaxSim FLOPs by up to ${\sim}8\times$, for up to ${\sim}13\times$ single-thread CPU speedups across x86 and ARM. A drop-in reranking layer, it needs no retraining or index changes.

检索优化延迟交互采样算法效率提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。