用迭代推理框架提升视觉语言模型对长时序任务进展的判断能力
Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress
- 通过循环推理机制逐段处理视频,维护动态思维链记录任务进展
- 在ALFRED和Ego4D数据集上达到新最优性能,支持复杂时序依赖推理
- 适合需要长期任务规划的机器人、智能助手等场景应用
准确估计任务进展对具身智能体完成长时序多步骤任务至关重要。现有基于视觉语言模型(VLM)的方法主要依赖其视频理解能力,忽视了其深层推理潜力,且处理长视频轨迹计算开销大。为此,本文提出循环推理视觉语言模型(R²VLM),采用递归推理框架,分段处理视频片段,通过持续演化的思维链(CoT)保持全局上下文。该思维链显式记录任务分解、关键步骤及完成状态,实现对复杂时序依赖的推理。此设计避免了长视频整体处理的高成本,同时保留核心推理能力。模型在大规模自动生成的ALFRED与Ego4D数据集上训练,实验表明其在任务进展估计及下游应用(如增强型策略学习、强化学习奖励建模、主动辅助)中表现优异,达成长时序任务进展估计新基准。代码与评测集已公开于Hugging Face。
原文摘要 · Abstract (English)
Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models (VLMs) based methods primarily leverage their video understanding capabilities, while neglecting their complex reasoning potential. Furthermore, processing long video trajectories with VLMs is computationally prohibitive for real-world deployment. To address these challenges, we propose the Recurrent Reasoning Vision-Language Model ($\text{R}^2$VLM). Our model features a recurrent reasoning framework that processes local video snippets iteratively, maintaining a global context through an evolving Chain of Thought (CoT). This CoT explicitly records task decomposition, key steps, and their completion status, enabling the model to reason about complex temporal dependencies. This design avoids the high cost of processing long videos while preserving essential reasoning capabilities. We train $\text{R}^2$VLM on large-scale, automatically generated datasets from ALFRED and Ego4D. Extensive experiments on progress estimation and downstream applications, including progress-enhanced policy learning, reward modeling for reinforcement learning, and proactive assistance, demonstrate that $\text{R}^2$VLM achieves strong performance and generalization, achieving a new state-of-the-art in long-horizon task progress estimation. The models and benchmarks are publicly available at \href{https://huggingface.co/collections/zhangyuelin/r2vlm}{huggingface}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。