arXiv:2605.27960cs.CV2026-05

用强化学习让多模态大模型自带放大镜,精准分析复杂图像细节。

Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning

论文配图:Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning
图 1 · 摘自论文原文
  • 通过代理强化学习自动定位图像关键区域,无需额外标注。
  • 仅需40个样本即可训练,实现高分辨率细粒度视觉推理。
  • 适合需要精准视觉理解的复杂场景问答任务。

尽管多模态大语言模型(MLLMs)广受欢迎且表现优异,但在复杂场景(如物体密度高、背景杂乱)中常难以准确解析图像,限制了其推理能力。以往工作主要依赖边界框等显式视觉提示,但这些方法需额外标注,且低分辨率裁剪常丢失细粒度信息。为此,我们提出Mags-RL,一种基于代理强化学习(Agentic RL)的框架,为MLLM配备外部超分辨率“放大镜”代理,实现高分辨率细粒度检查。模型进行两轮推理:第一轮生成初始推理并自主识别感兴趣区域;第二轮调用超分辨率代理裁剪并上采样这些区域,再回溯验证早期推理以得出最终答案。我们还引入新颖的课程学习策略,实现数据高效的强化学习训练,仅需40个训练样本即达合理性能。在VSR、TallyQA和GQA子集上的实验表明,该方法显著优于近期强基线,展现出高质量、精确视觉定位的推理能力。代码与权重将很快发布。

原文摘要 · Abstract (English)

Despite their popularity and success, Multimodal Large Language Models (MLLMs) often struggle to interpret images accurately, which limits their reasoning capability in complex scenarios (e.g., high object density and complex background clutter). Prior work mainly addresses this limitation by incorporating explicit visual cues like bounding boxes that require extra annotations. In addition, the resulting low-resolution crops often miss fine-grained details that MLLMs require for accurate reasoning. Therefore, we propose Mags-RL, an Agentic Reinforcement Learning (RL) framework that equips MLLMs with an external super-resolution "magnifying glass" agent for high-resolution fine-grained inspection. Specifically, the model performs two-round reasoning: in the first round, it generates an initial rationale and autonomously identifies regions of interest without relying on additional annotations; in the second round, it invokes a super-resolution agent to crop and upscale those regions, then revisits and verifies its earlier reasoning to produce the final answer. We also introduce a novel curriculum learning strategy that enables data-efficient RL training, needing as few as only 40 training samples to achieve reasonable performance. Experiments on VSR, TallyQA, and GQA subsets show its superior performance against recent strong competing methods, demonstrating high-quality reasoning with precise visual grounding. Code and weights will be released soon.

多模态强化学习视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。