让文档在编码时就生成多种语义解释,提升查询匹配精度。
VaRS-Doc: Interpretation-Aware Variant Representations via Latent Self-Probing for Visual Document Retrieval

- 通过潜空间自探机制动态生成多种文档表示
- 在多个基准上达到最优检索性能,超越现有方法
- 适合需要精准匹配查询意图的文档搜索场景
视觉文档检索在企业搜索、学术文献发现和检索增强生成等应用中日益重要,需高效识别海量视觉文档中的相关页面。现有方法多采用离线编码的延迟交互架构,虽具备高效率和低延迟,但将文档编码为固定表示后无法适应不同查询意图,而延迟编码又导致在线检索延迟过高。为此,本文提出VaRS-Doc框架,在文档编码阶段通过潜空间自探主动探索多种潜在语义解释,同时保持高效的延迟交互检索机制,使每个查询可自适应选择最匹配的表示。进一步设计两阶段训练策略,促进模型学习互补语义解释,避免退化为单一主导表示。在多个视觉文档检索基准上,VaRS-Doc实现领先性能,有效缓解查询无关编码与查询特定需求之间的矛盾。代码已开源。
原文摘要 · Abstract (English)
Visual document retrieval has recently become increasingly important in applications such as enterprise search, scientific literature discovery, and retrieval-augmented generation. These applications depend on efficiently identifying query-relevant pages across large collections of visually rich documents. Existing methods commonly adopt late-interaction architectures that encode and index documents offline to enable scalable and low-latency online retrieval. Despite its efficiency, this paradigm requires each document to be encoded into a fixed representation before the query is known. However, the same content in a visual document may induce different interpretations depending on the query intent, which a fixed representation struggles to capture. Yet postponing document encoding until the query arrives would incur prohibitive online retrieval latency. To address this gap, we propose VaRS-Doc, a visual document retrieval framework that diversifies document representations by enabling the model to actively explore variant latent interpretations during document encoding, while preserving efficient late-interaction retrieval in which each query adaptively selects the best-fit representation. We further introduce a two-stage training strategy that encourages the model to capture complementary semantic interpretations and prevents it from falling back to train a single dominant representation. Experiments on visual document retrieval benchmarks show that VaRS-Doc achieves state-of-the-art retrieval performance, offering a practical solution to the mismatch between query-agnostic document encoding and query-specific retrieval needs. Code is available at https://github.com/bokufa/VaRS-Doc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。