通过并行模拟多步路径,提升智能体在复杂环境中的推理能力
ParallelWorld: Test-Time Scaling for Embodied Reasoning

- 采用验证器引导的树搜索,同时模拟多步未来路径
- 在ESI-Bench上显著提升主动感知与推理性能
- 适合需要长程规划的机器人导航与交互任务
具身推理是具身智能的基础能力,支撑自主感知、推理与物理环境交互。近期研究将具身推理范式从静态感知转向动态探索,即智能体通过与环境互动获取任务相关信息。然而,现有主动推理方法通常增量生成探索轨迹,缺乏长程规划能力。即使新兴的测试时扩展框架也多依赖短视的单步前瞻,难以应对复杂遮挡环境中延迟反馈的问题。为此,我们提出ParallelWorld,一种面向具身推理的多时域测试时扩展框架。该框架不采用贪婪的单步试探,而是让智能体在执行动作前并行模拟和评估多步未来轨迹。具体而言,引入验证器引导的树搜索机制:从当前状态出发,分支出多个并行轨迹,并在多步时域内持续展开。每一步模拟中,验证器评估中间状态转移,动态剪枝低潜力分支,优先保留信息增益最高的路径。多步前瞻性模拟完成后,智能体综合长程结果,确定最优动作序列。最终,答案智能体基于选定轨迹进行推理,输出最终结论。在ESI-Bench上的大量实验表明,ParallelWorld持续提升了主动感知与推理性能。
原文摘要 · Abstract (English)
Embodied Reasoning constitutes a fundamental capability of embodied intelligence, serving as the basis for autonomous perception, reasoning, and interaction within physical environments. Recent studies have shifted the paradigm of embodied reasoning from static perception toward dynamic exploration, where agents acquire task-relevant information through interactions with the environment. However, existing active reasoning approaches generally generate exploration trajectories incrementally without long-horizon planning. Even recently emerged test-time scaling frameworks often resort to myopic, single-step lookaheads, which struggle to resolve the delayed feedback inherent in complex, occluded spatial environments. To address this limitation, we propose ParallelWorld, a multi-horizon test-time scaling framework for embodied reasoning. Instead of greedy, single-step trials, ParallelWorld empowers agents to simulate and evaluate multi-step future trajectories in parallel before committing to an action. Specifically, we introduce a verifier-guided tree-search paradigm. Starting from the current state, ParallelWorld branches into multiple parallel trajectories and rolls them out continuously across a multi-step horizon. At each simulation step, a verifier agent evaluates the intermediate state transitions, dynamically pruning unpromising branches and prioritizing paths with the highest information gain. Once the multi-step prospective simulation is complete, the agent synthesizes the long-horizon outcomes to commit to the optimal action sequence. Finally, an answer agent performs reasoning over the selected trajectory to produce the final reasoning. Extensive experiments on ESI-Bench demonstrate that ParallelWorld consistently improves active perception and reasoning performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。