arXiv:2606.08719cs.CV2026-06被引 3

让模型通过想象代替反复看图,提升推理效率。

Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation

论文配图:Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation
图 1 · 摘自论文原文
  • 用自蒸馏框架让模型学会在心中‘想象’关键区域细节
  • 在多个视觉任务上表现优于现有方法,推理速度更快
  • 适合追求高效智能推理的研究者和开发者

‘看图思考’通过聚焦图像局部区域进行细粒度推理,能获取全局图像难以捕捉的细节证据。但该方法依赖重复调用工具,推理过程冗长,且基于结果奖励学习时,中间生成的图像裁剪可能噪声大、不准确。本文提出 Imagine-OPD,一种基于策略的自蒸馏框架:训练中,教师角色以‘看图思考’方式接收标注区域的精确放大视图,监督学生模型的想象推理轨迹。该方法无需外部教师或高质量想象示范。在多个视觉基准测试中,Imagine-OPD 在平均性能上超越对比模型,同时显著降低推理开销。

原文摘要 · Abstract (English)

''Thinking with Images'' has emerged as an effective paradigm for fine-grained visual reasoning: by explicitly zooming into relevant regions and reasoning over crops, models can access local evidence that is difficult to recover from a single global image. However, this benefit comes with redundant tool invocations and longer inference traces. Moreover, when such behaviors are learned mainly from outcome reward, the resulting intermediate crops or visual cues can be noisy or fail to faithfully capture task-relevant visual evidence. In this work, we ask whether the reasoning benefits of ''Thinking with Images'' can be internalized through Thinking with Imagination: an internal process that decides where to look and imagines what visual cues closer inspection would reveal without actually invoking tools. We propose Imagine-OPD, an on-policy self-distillation framework in which a teacher plays the role of a ''Thinking with Images'' reasoner during training: it receives privileged zoomed evidence views derived from annotated regions, and supervises the model's own imagination reasoning trajectories. Imagine-OPD does not require an external teacher or high-quality imagination demonstrations. Experiments on vision-centric benchmarks show that Imagine-OPD achieves the best average performance among compared models while significantly reducing inference overhead compared with ''Thinking with Images'' methods.

视觉推理自蒸馏想象机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。