arXiv:2608.10636cs.IRcs.CL2026-08

用双学生蒸馏压缩大模型,实现高效视觉文档检索。

DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation

  • 双向蒸馏构建紧凑单向量检索器,仅需教师模型嵌入监督。
  • 在高分辨率数据集上达61.74 NDCG@5,性能为80亿模型的86.9%。
  • 索引体积缩小15.6倍,速度提升一个数量级,适合部署场景。

视觉文档检索(VDR)依赖于数十亿参数的大模型,导致索引慢、服务成本高。现有压缩方法要么从头训练小模型,要么仅蒸馏查询端,无法实现端到端的紧凑单向量检索器。本文提出DistilVDR,一个524M参数的端到端VDR系统,通过点对点余弦对齐损失,从单个80亿参数的视觉语言教师模型中进行双向蒸馏。所有监督来自冻结教师的嵌入空间,无需相关性标签、负样本或对比学习。针对文本查询与图像文档的输入不对称性,设计非对称编码器结构:文档侧集中视觉能力,查询侧保持70M参数。释放两个变体:DistilVDR-HiRes在ViDoRe v1+v2+v3上达61.74平均NDCG@5(为80亿教师的86.9%),在高分辨率敏感的v3基准上优于所有复现的亚10亿基线;DistilVDR-Fast以三倍更小的视觉标记预算达到59.98。两者均在100万文档上建立比最强亚10亿多向量基线小15.6倍的索引,且索引速度快一个数量级。代码已开源。

原文摘要 · Abstract (English)

Visual document retrieval (VDR) is dominated by multi-billion-parameter models that are slow to index at full corpus scale and expensive to serve. Prior compression routes either train a smaller multi-vector encoder from scratch or distil only the query side; neither yields a compact single-vector retriever end-to-end. We present DistilVDR, a 524M end-to-end VDR system distilled bilaterally from a single 8B vision-language teacher under a pointwise cosine alignment loss. All supervision comes from the frozen teacher's embedding space, which was itself trained with relevance supervision, so the student objective needs no relevance labels, negative sampling, or contrastive term. We match VDR's text-query and image-document input asymmetry with an asymmetric encoder-only student that concentrates visual capacity on the document side and keeps the query side at 70M parameters. We release two variants that share the same encoders and training and differ only in the document encoder's visual-tile budget: DistilVDR-HiRes attains 61.74 average NDCG@5 on ViDoRe v1+v2+v3 (86.9% of the 8B teacher) and leads every reproduced sub-1B baseline on the high-resolution-sensitive v3 benchmark, while DistilVDR-Fast attains 59.98 at a 3 times smaller visual-token budget. Both variants store one million documents in a 15.6 times smaller index than the strongest sub-1B multi-vector baseline and index the corpus an order of magnitude faster. The code is available at https://github.com/Ryenhails/NanoVDR.

视觉检索模型压缩蒸馏文档搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。