arXiv:2604.17475cs.AIcs.CL2026-04ACL

无需人工标注,让小模型自主学会看图做事

Waking Up Blind: Cold-Start Optimization of Supervision-Free Agentic Trajectories for Grounded Visual Perception

论文配图:Waking Up Blind: Cold-Start Optimization of Supervision-Free Agentic Trajectories for Grounded Visual Perception
图 1 · 摘自论文原文
  • 用自监督方式训练小模型按步骤使用工具
  • 任务准确率提升5%,工具使用效率提高9%
  • 适合研究多模态智能体与低成本训练的开发者

小型视觉语言模型(SVLMs)虽高效,但易受视觉干扰且工具使用混乱。现有方法依赖昂贵的人工标注轨迹来优化。本文提出SPECTRA框架,通过冷启动强化学习实现无监督训练,强制智能体在推理前显式排序工具产生的视觉证据,确保思维扎根于真实观察。采用多目标奖励机制,同时优化任务正确性、推理结构和工具效用,使智能体无需人类偏好标签即可自我发现鲁棒行为。引入工具工具效用(TIU)量化工具实际价值。在复合任务与MMMU-Pro等分布外基准上测试,SPECTRA将任务准确率提升最高5%,工具效率提升9%,显著增强多模态智能体从环境交互中学习的能力。

原文摘要 · Abstract (English)

Small Vision-Language Models (SVLMs) are efficient task controllers but often suffer from visual brittleness and poor tool orchestration. They typically require expensive supervised trajectory tuning to mitigate these deficits. In this work, we propose Self-supervised Perception Enabled by Cascaded Tool Rollout Alignment (SPECTRA), a supervision-free framework that bootstraps agentic capabilities via Coldstart Reinforcement Learning for SVLMs. SPECTRA enforces Soft Structured Multi-turn Rollouts, a topological constraint that directs agents to explicitly sequence tool derived evidence before synthesis, effectively grounding reasoning in visual observations. We employ a multi-objective reward signal that simultaneously maximizes task correctness, rollout structure, and tool utility, enabling agent to self-discover robust behaviors without human preference labels. We further introduce Tool Instrumental Utility (TIU), a novel metric to quantify tool efficacy in the absence of ground truth. Extensive evaluations across composite and out-of-distribution (MMMU-Pro) benchmarks demonstrate that SPECTRA boosts agentic trajectories, improving task accuracy by up to 5% and tool efficiency by 9%, enabling more efficient multimodal agents that learn effectively from environmental interaction alone.

多模态智能体自监督学习强化学习小模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。