用扩散模型生成避障路径,结合实时控制提升机器人运动效率。
Warm-Starting Collision-Free Model Predictive Control With Object-Centric Diffusion
- 用物体中心注意力编码环境,指导扩散模型生成避障轨迹。
- 在基准测试中成功率更高,延迟低于采样规划方法。
- 适合需要快速安全避障的机器人控制场景。
在杂乱环境中行动需同时预测并避免碰撞,实现精准控制。传统基于优化的控制器虽能施加物理约束,但在障碍物众多时难以快速求得可行解。扩散模型可生成多样化的绕障轨迹,但以往方法缺乏对场景结构的通用高效条件化方式。本文提出将扩散模型的暖启动与物体中心的潜在表征相结合,并接入碰撞感知的模型预测控制器(MPC),在严格时间限制下实现可靠高效的运动生成。该方法以系统状态、任务目标和周围环境为条件,通过物体中心槽注意力机制提供紧凑的障碍物表示,用于控制。采样得到的轨迹经最优控制问题精炼,强制满足刚体动力学和带符号距离的碰撞约束,实现实时可行运动。在基准任务中,该混合方法显著优于采样规划器或单一组件,成功率更高,延迟更低。真实机器人实验使用力矩控制的Panda机械臂,验证了其执行的可靠性和安全性。
原文摘要 · Abstract (English)
Acting in cluttered environments requires predicting and avoiding collisions while still achieving precise control. Conventional optimization-based controllers can enforce physical constraints, but they struggle to produce feasible solutions quickly when many obstacles are present. Diffusion models can generate diverse trajectories around obstacles, yet prior approaches lacked a general and efficient way to condition them on scene structure. In this paper, we show that combining diffusion-based warm-starting conditioned with a latent object-centric representation of the scene and with a collision-aware model predictive controller (MPC) yields reliable and efficient motion generation under strict time limits. Our approach conditions a diffusion transformer on the system state, task, and surroundings, using an object-centric slot attention mechanism to provide a compact obstacle representation suitable for control. The sampled trajectories are refined by an optimal control problem that enforces rigid-body dynamics and signed-distance collision constraints, producing feasible motions in real time. On benchmark tasks, this hybrid method achieved markedly higher success rates and lower latency than sampling-based planners or either component alone. Real-robot experiments with a torque-controlled Panda confirm reliable and safe execution with MPC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。