让机器人从执行失败中学习恢复,提升长时物理任务的鲁棒性。
From Failures to Supervision: DynamicEnvPlan for Robust Long-Horizon Embodied Planning

- 将环境扰动转化为可学习的恢复轨迹,实现闭环训练
- 在104个场景中成功率从33.3%提升至76.2%
- 适合研究具身智能与动态环境交互的开发者
真实世界交互本质上是动态的,环境在执行过程中可能发生改变,要求智能体在非平稳条件下适应并调整计划。本文针对长时具身规划中的环境偏差与执行不确定性问题,提出DynamicEnvPlan框架。该框架扩展了人形代理的高阶任务执行能力,包含高阶基础技能、结构化语义记忆和可控扰动机制。通过规划、扰动与受保护修正模块构建数据生成流程,将动态执行状态转化为面向恢复的轨迹。这些轨迹用于分阶段监督微调,使规划器既能学习正常执行,也能学习扰动后的恢复策略。在104个涵盖i.i.d.、组合泛化和分布外设置的任务-场景组合上进行微调与评估,结果表明,相较于基线规划器,成功率达76.2%,同时在七项关键指标(包括安全性和可操作性合规性)上全面提升。
原文摘要 · Abstract (English)
Physical-world interaction is inherently dynamic, as environments can evolve during execution, requiring agents to adapt their plans under non-stationary conditions. We study this challenge through long-horizon embodied planning under environment deviations and execution uncertainty. Existing embodied-task benchmarks can expose such failures, but these failures are usually treated as evaluation outcomes instead of learnable signals for training agents to recover. In this work, we introduce DynamicEnvPlan, a closed-loop framework for high-level planning in dynamic environments. It extends embodied task execution with humanoid agents, high-level primitive skills, structured semantic memory, and controllable perturbations. Our data synthesis design consists of planning, perturbation, and guarded correction modules that turn dynamic execution states into recovery-oriented traces. The resulting traces are used for staged supervised fine-tuning, enabling the planner to learn from both nominal execution and perturbed recovery trajectories. Using 104 task-scene combinations spanning i.i.d., compositional generalization, and out-of-distribution settings for fine-tuning and evaluation, DynamicEnvPlan boosts success rate from 33.3% for the base planner to 76.2%, while improving across all seven evaluation metrics critical to physical-world interaction, including safety and affordance compliance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。