arXiv:2608.29357cs.AI2026-08

用小模型复现大模型搜索能力,关键在行为模仿而非单纯提效

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

论文配图:LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO
图 1 · 摘自论文原文
  • 基于释放轨迹与合成偏好学习,小模型模仿大模型决策流程
  • 2B模型答对率从0.3%提升至28.4%,接近4B基线表现
  • 发现验证答案比增加搜索深度更关键,为小型多模态代理指明方向

多模态搜索代理通过交替进行图像理解、网络检索、工具使用和证据整合来回答视觉问题。现有强系统依赖昂贵路径:如GPT-5、Gemini等专有前沿模型,或需大量代理数据和强化学习训练的大规模开源视觉语言骨干。本文提出新问题:当将已发布的代理轨迹在单节点预算下蒸馏到极小骨干模型时,真正传递的是什么?我们构建LiteSearch-VL,一种针对Qwen3-VL-2B和Qwen3-VL-4B的低计算方案,仅使用公开的OpenSearch-VL轨迹、参数高效的LoRA适配器及合成的步骤级偏好(DPO),利用GPT-5生成的硬负例针对五种局部失败模式(提前作答、错误工具、弱查询、重复查询、忽略图像)。在SimpleVQA、FVQA、LiveVQA和VDR-Bench-testmini上共12,400次由GPT-5评估的回放中,主导效应是行为迁移而非统一准确率提升:全轨迹监督微调使2B模型从几乎不输出有效答案(1,237/1,240无答案回放)提升至28.4%宏平均Pass@1,达到甚至略超现成4B基础模型(25.6%)。合成偏好学习与紧凑工具蒸馏仅作为优化而非质变(最佳4B配置:30.8%宏平均Pass@1)。受控的VDR步数消融实验表明,额外搜索将沉默转为错误实体,而非正确答案,揭示小模型代理的下一个瓶颈在于答案验证,而非搜索深度。

原文摘要 · Abstract (English)

Multimodal search agents answer visual questions by interleaving image understanding, web retrieval, tool use, and evidence synthesis. Strong systems exist, but in two expensive regimes: proprietary frontier models such as GPT-5 and Gemini, or large open vision-language backbones trained with substantial agentic data and reinforcement learning. We ask a different question: when released agent trajectories are distilled into much smaller backbones under a single-node budget, what is actually transferred? We study this with LiteSearch-VL, a low-compute recipe for Qwen3-VL-2B and Qwen3-VL-4B that uses only released OpenSearch-VL trajectories, parameter-efficient LoRA adapters, and synthetic step-level preferences: DPO on GPT-5-generated hard negatives targeting five local failure modes (premature answer, wrong tool, weak query, repeated query, ignored image). Across 12,400 GPT-5-judged rollouts on SimpleVQA, FVQA, LiveVQA, and VDR-Bench-testmini, the dominant effect is behavioral rather than a uniform accuracy lift: full-trajectory supervised fine-tuning transfers the agent contract, taking the 2B model from almost never emitting a usable answer (1,237/1,240 no_answer rollouts) to 28.4% macro Pass@1, matching or slightly exceeding the off-the-shelf 4B base (25.6%). Synthetic preference learning and compact tool distillation act as refinements rather than phase transitions (best 4B configuration: 30.8% macro Pass@1). Finally, a controlled VDR step-budget ablation shows that extra search turns convert abstentions into wrong_entity errors rather than correct answers, identifying answer verification, not search depth, as the next bottleneck for small multimodal agents.

多模态搜索小模型蒸馏偏好学习代理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。