arXiv:2512.24330cs.CV2025-12被引 27

让视觉语言模型像人一样边看图边查资料边操作,用强化学习实现智能推理与工具协同。

SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning

  • 通过强化学习让模型动态调用搜索、裁剪等工具,实现视觉推理与操作的无缝融合。
  • 在高分辨率图像搜索任务上,32B模型达54.4分,超越谷歌和GPT-5.2等闭源模型。
  • 开源代码、模型和首个面向高分辨率图像的搜索评测集,适合多模态智能体研究者。

尽管视觉语言模型(VLMs)可通过代理式推理解决复杂任务,但其能力仍主要局限于文本导向的思维链或孤立的工具调用。它们无法在知识密集型和视觉复杂的场景中,像人类一样流畅地交织动态工具操作与持续推理,尤其在需要协调外部工具(如搜索、图像裁剪)时表现不足。本文提出SenseNova-MARS,一种基于强化学习(RL)的多模态代理推理与搜索框架,使VLMs具备交错的视觉推理与工具使用能力。具体而言,SenseNova-MARS动态整合图像搜索、文本搜索与图像裁剪工具,应对细粒度且知识密集的视觉理解挑战。在强化学习阶段,我们提出批量归一化组序列策略优化(BN-GSPO)算法,提升训练稳定性并增强模型调用工具与推理的能力。为全面评估复杂视觉任务上的代理式VLMs,我们引入首个以高分辨率图像为基础、面向搜索的基准测试集HR-MMSearch。实验表明,SenseNova-MARS在开源搜索与细粒度图像理解基准上达到领先水平。在搜索类基准上,SenseNova-MARS-32B在MMSearch上得分为74.3,在HR-MMSearch上得分为54.4,优于谷歌的Gemini-3-Pro和GPT-5.2等闭源模型。SenseNova-MARS为实现具备有效且鲁棒工具使用能力的代理式VLMs迈出了重要一步。为促进该领域研究,我们将开源全部代码、模型与数据集。

原文摘要 · Abstract (English)

While Vision-Language Models (VLMs) can solve complex tasks through agentic reasoning, their capabilities remain largely constrained to text-oriented chain-of-thought or isolated tool invocation. They fail to exhibit the human-like proficiency required to seamlessly interleave dynamic tool manipulation with continuous reasoning, particularly in knowledge-intensive and visually complex scenarios that demand coordinated external tools such as search and image cropping. In this work, we introduce SenseNova-MARS, a novel Multimodal Agentic Reasoning and Search framework that empowers VLMs with interleaved visual reasoning and tool-use capabilities via reinforcement learning (RL). Specifically, SenseNova-MARS dynamically integrates the image search, text search, and image crop tools to tackle fine-grained and knowledge-intensive visual understanding challenges. In the RL stage, we propose the Batch-Normalized Group Sequence Policy Optimization (BN-GSPO) algorithm to improve the training stability and advance the model's ability to invoke tools and reason effectively. To comprehensively evaluate the agentic VLMs on complex visual tasks, we introduce the HR-MMSearch benchmark, the first search-oriented benchmark composed of high-resolution images with knowledge-intensive and search-driven questions. Experiments demonstrate that SenseNova-MARS achieves state-of-the-art performance on open-source search and fine-grained image understanding benchmarks. Specifically, on search-oriented benchmarks, SenseNova-MARS-32B scores 74.3 on MMSearch and 54.4 on HR-MMSearch, surpassing proprietary models such as Gemini-3-Pro and GPT-5.2. SenseNova-MARS represents a promising step toward agentic VLMs by providing effective and robust tool-use capabilities. To facilitate further research in this field, we will release all code, models, and datasets.

多模态智能体强化学习视觉搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。