arXiv:2607.02907cs.CVcs.CL2026-07中稿 · ECCV被引 1

让大模型在潜空间逐步推理解图,无需外部工具。

ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space

论文配图:ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space
图 1 · 摘自论文原文
  • 用自蒸馏机制让模型自己监督潜空间推理过程。
  • 在多个视觉推理任务上超越基线,准确率显著提升。
  • 适合需要可解释性推理的复杂视觉任务研究者。

多模态大语言模型虽取得显著进展,但在需多步感知与逻辑推断的复杂视觉任务上仍表现不足。显式图像生成成本过高,现有潜空间方法或依赖外部专家,或缺乏严谨认知逻辑。本文提出ProLaViT(渐进式潜空间视觉思维),使MLLMs能在连续潜空间中进行结构化视觉推导。不同于依赖异构外部模型的方法,ProLaViT采用内生自蒸馏机制,利用模型自身视觉编码器监督潜思过程。我们构建可扩展的程序化合成流水线,使模型在不依赖推理时工具的情况下内化算法精度。设计两种推理范式:(1) 从粗到细因果链,用于空间任务,引导注意力由全局上下文转向局部目标;(2) 辩证推理链,用于逻辑任务,引入反事实思考进行验证。此外,提出距离加权多样性损失,施加拓扑感知约束,防止特征退化,确保语义区分度。大量实验表明,ProLaViT在以视觉为中心的基准测试中优于基线,实现更高准确率、可解释性与高效性。

原文摘要 · Abstract (English)

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but still struggle with complex visual reasoning tasks requiring multi-step perception and logical deduction. While explicit visual generation incurs prohibitive computational costs, existing latent approaches often rely on external experts or lack rigorous cognitive logic. In this paper, we introduce ProLaViT (Progressive Latent Visual Thought), a framework empowering MLLMs to perform structured visual derivation in the continuous latent space. Unlike works dependent on heterogeneous external models, ProLaViT leverages an endogenous self-distillation mechanism, utilizing the model's own visual encoder to supervise latent thoughts. To facilitate this, we construct a scalable programmatic synthesis pipeline enabling the model to internalize algorithmic precision without inference time tools. We design two reasoning paradigms: (1) Coarse-to-Fine Causal Chain for spatial tasks, guiding attention from global context to local targets. (2) Dialectical Reasoning Chain for logical tasks, incorporating counter-factual thinking for verification. Furthermore, we propose a Distance-Weighted Diversity Loss to impose topology-aware constraints, preventing feature degeneration by enforcing semantic distinctiveness. Extensive experiments demonstrate that ProLaViT outperforms baselines on vision-centric benchmarks, achieving superior accuracy and interpretability with high efficiency.

视觉推理潜空间多模态自蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。