arXiv:2510.07030cs.RO2025-10被引 1

用扩散模型自动识别抓取失误并规划恢复动作,提升多指操作鲁棒性。

Diffusing Trajectory Optimization Problems for Recovery During Multi-Finger Manipulation

  • 基于扩散模型检测异常状态,实现任务中断的自主判断
  • 恢复轨迹优化使拧螺丝任务成功率提升96%,且不引发灾难性失败
  • 新方法在线推理更快,可端到端优化接触约束与目标状态

多指手正成为精细操作任务(如工具使用)的重要平台。然而环境扰动或执行误差可能阻碍任务完成,促使需引入恢复行为以重新启动正常操作。本文利用扩散模型构建框架,自主判断是否需要恢复,并优化富含接触的恢复轨迹。通过在任务数据上训练的扩散模型,将非理想状态视为分布外样本进行检测;随后使用扩散采样将其映射回合理状态,并结合轨迹优化规划出高接触强度的恢复路径。我们还提出一种新型扩散方法,能高效地对恢复轨迹优化问题的全部参数(包括约束、目标状态和初始条件)进行端到端扩散,显著降低在线执行时间。与强化学习基线及其他未显式规划接触交互的方法相比,本方法在硬件拧螺丝任务中将任务成功率提升96%,且唯一可在不引发灾难性失败的前提下尝试恢复。视频展示见https://dtourrecovery.github.io/。

原文摘要 · Abstract (English)

Multi-fingered hands are emerging as powerful platforms for performing fine manipulation tasks, including tool use. However, environmental perturbations or execution errors can impede task performance, motivating the use of recovery behaviors that enable normal task execution to resume. In this work, we take advantage of recent advances in diffusion models to construct a framework that autonomously identifies when recovery is necessary and optimizes contact-rich trajectories to recover. We use a diffusion model trained on the task to estimate when states are not conducive to task execution, framed as an out-of-distribution detection problem. We then use diffusion sampling to project these states in-distribution and use trajectory optimization to plan contact-rich recovery trajectories. We also propose a novel diffusion-based approach that distills this process to efficiently diffuse the full parameterization, including constraints, goal state, and initialization, of the recovery trajectory optimization problem, saving time during online execution. We compare our method to a reinforcement learning baseline and other methods that do not explicitly plan contact interactions, including on a hardware screwdriver-turning task where we show that recovering using our method improves task performance by 96% and that ours is the only method evaluated that can attempt recovery without causing catastrophic task failure. Videos can be found at https://dtourrecovery.github.io/.

多指操作扩散模型轨迹优化恢复策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。