arXiv:2608.08732cs.CVcs.CL2026-08

通过递归注意力传播,实现文档检索的高效向量压缩。

AnchorFold: A Focus-Then-Fold Framework via Recursive Attention Propagation for Efficient Multi-Vector Visual Document Retrieval

论文配图:AnchorFold: A Focus-Then-Fold Framework via Recursive Attention Propagation for Efficient Multi-Vector Visual Document Retrieval
图 1 · 摘自论文原文
  • 基于注意力图递归传播,分聚焦与折叠两阶段压缩
  • 在5倍压缩下保留98.3%检索性能,20倍压缩仍达92.4%
  • 无需训练,适合追求低存储开销的视觉文档检索系统

多向量视觉语言检索器通过晚期交互实现细粒度文档检索,但每页存储数百个视觉补丁嵌入带来巨大开销。现有无训练方法依赖剪枝或合并:剪枝在激进压缩下性能急剧下降,合并则未显式优先重要区域。我们提出AnchorFold,一种无训练的聚焦-折叠框架,用于文档端索引压缩。该方法在视觉自注意力图上应用递归注意力传播,每个注意力头内进行多步传播,并融合各头与层的得分。聚焦阶段选取高中心性标记作为锚点;折叠阶段将剩余标记分配至最相似的锚点,并以中心性加权聚合锚点周围组。该方法在保留非锚点贡献的同时,集中容量于结构重要标记。在ViDoRe v1/v2和REAL-MM-RAG上,使用三种不同检索骨干网络,AnchorFold在γ≤0.20时持续优于所有评估的无训练基线。在ViDoRe v1/v2上,5倍压缩下平均保留98.3%全索引NDCG@5,实现近无损压缩;20倍压缩下仍保持92.4%。

原文摘要 · Abstract (English)

Multi-vector vision-language retrievers enable fine-grained Visual Document Retrieval (VDR) through late interaction, but storing and scoring hundreds of visual patch embeddings per page incurs substantial overhead. Existing training-free methods rely on pruning or merging: pruning degrades sharply under aggressive compression, whereas merging does not explicitly prioritize important regions when forming representatives. We introduce AnchorFold, a training-free focus-then-fold framework for document-side index compression. AnchorFold applies Recursive Attention Propagation over visual self-attention graphs, performing multi-step propagation within each attention head and integrating scores across heads and layers. The focus stage selects the highest-centrality tokens as anchors. The fold stage assigns remaining tokens to their most similar anchors in the normalized retrieval space and summarizes each anchor-centered group through centrality-weighted aggregation. This preserves non-anchor contributions while concentrating capacity on structurally important tokens. Across ViDoRe v1/v2 and REAL-MM-RAG with three diverse retrieval backbones, AnchorFold consistently outperforms all evaluated training-free baselines at $γ\leq 0.20$. On ViDoRe v1/v2, it retains 98.3% of full-index NDCG@5 on average at $5\times$ compression, achieving near-lossless compression, and 92.4% at $20\times$ compression.

文档检索向量压缩注意力传播无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。