arXiv:2606.26122cs.CV2026-06被引 2

自动生成多模态文档搜索训练环境,提升智能搜索代理的可控性与泛化能力。

DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents

论文配图:DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents
图 1 · 摘自论文原文
  • 用多模态大模型自动解析文档,构建结构化索引与跨页信息关联
  • 生成79,000个涵盖49种语言、16个领域的高难度问答对,支持多模态检索
  • 设计可解耦感知与推理的架构,让文本大模型胜任多模态文档搜索

现有方法通过(问题,答案,证据)三元组训练搜索代理,无需专家轨迹。这些三元组构成训练环境,直接影响代理的搜索策略与泛化能力。尽管已有研究提升数据质量,但现有环境仍以文本为主,难以构建可控、可扩展且支持多模态数据的训练环境。为此,我们提出DocArena,一个全自动数据整理流水线,满足多模态文档搜索与问答的实际需求。它将原始文档集合转化为无需人工标注的训练环境:首先基于多模态大模型(MLLM)进行视觉感知与文档结构化索引;接着利用跨页信息分布生成推理密集型问答对;最后通过多轮MLLM质量保证实现闭环优化。我们构建了DocArena-79K,包含8,336份文档、16个领域、49种语言的79,000个问答对。进一步设计了文档搜索代理基础设施,将视觉感知与策略模型解耦,使文本大模型可作为多模态文档检索与问答的推理核心。在统一评估框架下,仅改变策略模型,实验在六个多模态文档场景和七个文本问答基准上表明,基于DocArena训练的代理在检索准确率与问答质量上均表现最优。对代理搜索行为的分析也验证了训练环境的有效性与可控性。

原文摘要 · Abstract (English)

Recent methods train search agents via reinforcement learning from (question, answer, evidence) tuples without requiring expert trajectories. The tuples serve as the training environment, and whose properties directly shape what search strategies and generalization abilities the agent can develop. While prior works have made encouraging progress in improving training data quality, existing environments remain predominantly text-based and existing approaches can struggle to construct training environments that are controllable, scalable, and account for multimodal data. Given this, we propose DocArena, a fully automated data curation pipeline building on the practical need for multimodal document search and question-answering. It transforms raw document collections into training environments for search agents without any human annotation. The pipeline first structures and indexes documents through MLLM-based visual perception, then profiles and leverage the cross-page information distribution to construct reasoning-intensive QA pairs, as well as performs cascaded quality assurance operations via MLLM. We introduce DocArena-79K with QA pairs from 8,336 documents spanning 16 domains and 49 languages. We further design a Doc-Search agent infrastructure that decouples visual perception from the policy model, allowing text-based LLMs to serve as the reasoning backbone for multimodal document retrieval and QA. Under a unified evaluation framework where only the policy model differs, experiments on six multimodal document scenarios and seven text-based QA benchmarks show that agents trained on DocArena data achieve the best performance on both retrieval accuracy and QA quality. Further analysis on agent search behaviors confirms the effectiveness and controllability of the constructed training environment.

文档搜索多模态RL训练自动化构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。