用动作块条件的潜在图块创新监测,让机器人实时识别干扰并自动恢复。
PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation

- 基于动作块预测潜在图块演化,检测自身运动无法解释的残差。
- 在真实机器人上实现更稳定、更相关的干预触发,减少误判。
- 适合需要高鲁棒性的复杂场景机器人操作,如动态环境中的抓取。
基于学习的操纵策略在现实机器人操作中取得了显著进展,尤其在短时程动作生成方面。然而,在开放工作空间中,面对移动物体、临时遮挡或邻近扰动等局部场景动态,部署仍易失效。现有运行时监控方法通常依赖全局观测异常、策略不确定性或帧级视觉变化,难以区分任务相关风险与正常视觉波动。本文提出PATCH,一种动作块条件的潜在图块创新监控机制,用于部署阶段的干预。给定当前动作块,PATCH定义一个投影执行通道,预测通道内潜在图块的演化,并累积由机器人自身运动无法解释的持续残差。这些残差构成局部化干预信号,使PATCH-Router可暂停执行,选择可用恢复源,并在局部创新消失后恢复原策略。在真实机器人轨迹数据上的实验表明,PATCH产生的触发信号比现有方法更稳定、更具上下文相关性。真实机器人部署进一步验证了监控驱动的干预与策略恢复,实现对扰动感知的操纵能力。
原文摘要 · Abstract (English)
Learning-based manipulation policies have made substantial progress in real-world robot manipulation, particularly for short-horizon action generation. However, deployment in open workspaces remains fragile under unexpected local scene dynamics, such as moving objects, transient occlusions, or disturbances near the intended motion. Existing runtime monitors often rely on global observation anomalies, policy uncertainty, or frame-level visual changes, and struggle to distinguish task-relevant execution risk from benign visual variation. We introduce PATCH, an action-chunk-conditioned latent patch innovation monitor for deployment-time intervention. Given the active action chunk, PATCH defines a projected execution corridor, predicts latent patch evolution inside it, and accumulates persistent residuals unexplained by the robot's own motion. These residuals form a localized intervention signal that allows PATCH-Router to pause execution, select an available recovery source, and resume the original policy once localized innovation subsides. Experiments on real robot rollout data show that PATCH produces more stable and context-relevant triggers than competing runtime monitors. Real-robot deployment further demonstrates monitor-driven intervention and policy resumption for disturbance-aware manipulation. Project Page: https://yananzhou5555.github.io/PATCH/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。