arXiv:2608.02969cs.IR2026-08

通过保留查询相关覆盖区域,实现多向量文档检索的高效压缩。

Coverage Matters: MarginMerge for Compressing Multi-Vector Visual Document Retrievers

论文配图:Coverage Matters: MarginMerge for Compressing Multi-Vector Visual Document Retrievers
图 1 · 摘自论文原文
  • 基于覆盖感知选择锚点,聚类文档片段并合成代表性向量。
  • 在5%~10%向量保留率下,保持97%~99%的平均nDCG@5性能。
  • 适用于需要轻量化部署的跨数据集文档检索场景。

多向量视觉文档检索器如ColPali和ColQwen通过存储细粒度图像块嵌入实现强检索能力,但导致索引庞大且后期交互打分成本高。本文认为有效压缩应保留查询相关的覆盖范围,即可能成为不同查询最强最大相似度匹配的多样化文档区域,而非仅按显著性独立选取块。这一视角也解释了为何渲染页比自然图像更易压缩。我们提出MarginMerge,一种针对冻结多向量检索器的压缩方法:选择覆盖感知锚点,聚类文档块,并使用轻量共享网络为每簇合成一个代表向量。压缩仅在索引阶段执行,检索仍保持标准MaxSim接口。在六个数据集上(ColQwen2.5与ColPali),MarginMerge在5%和10%向量保留率下达到最高查询无关平均性能。相比同主干未压缩索引,其在90%~95%范围内减少存储向量数的同时,保持97%~99%的平均nDCG@5。在5%保留率下,相较于几何合并,六组ColQwen2.5数据集平均减少约41%的排序翻转。同一模型无需重训练即可迁移至未见数据集与保留率。

原文摘要 · Abstract (English)

Multi-vector visual document retrievers such as ColPali and ColQwen achieve strong retrieval by storing fine-grained patch embeddings, but this produces large indexes and costly late-interaction scoring. We argue that effective compression should preserve query-relevant coverage, meaning the diverse document regions that may become the strongest MaxSim match across queries, rather than selecting patches independently by salience. This view also explains why dense rendered pages are easier to compress than natural images. We introduce MarginMerge, a compression method for frozen multi-vector retrievers. It selects coverage-aware anchors, clusters document patches, and uses a lightweight shared network to synthesize one representative per cluster. Compression is performed once during indexing, while retrieval keeps the standard MaxSim interface. Across six datasets on both ColQwen2.5 and ColPali, MarginMerge achieves the highest matched query-agnostic average at 5% and 10% vector retention. Compared with the uncompressed index using the same backbone, it preserves between 97% and 99% of average nDCG@5 while reducing stored document vectors by between 90% and 95%. At 5% retention, it also reduces ranking flips relative to geometric merging on all six ColQwen2.5 datasets by approximately 41% on average. The same model transfers to unseen datasets and retention ratios without retraining.

文档检索向量压缩多向量检索优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。