通过掩码动作分块提升机器人实时执行的可靠性
Real-Time Robot Execution with Masked Action Chunking
- 用掩码分块让预训练策略学会修正执行偏差
- 在真实与仿真环境中任务完成率显著提升
- 适合需要低延迟、高鲁棒性的机器人系统
实时执行对机器人等网络物理系统至关重要。异步推理虽能实现实时响应,但常因动作分块间的不连续和分块内感知与执行的不一致导致失败。本文提出REMAC方法,通过掩码动作分块学习策略的修正能力,增强对意图与实际执行不匹配的鲁棒性;同时引入前缀保留采样以强化分块间连续性。实验表明,该方法在仿真与真实场景中均实现更快任务执行、更强延迟适应性,并显著提高任务完成率,且无额外延迟开销。
原文摘要 · Abstract (English)
Real-time execution is essential for cyber-physical systems such as robots. These systems operate in dynamic real-world environments where even small delays can undermine responsiveness and compromise performance. Asynchronous inference has recently emerged as a system-level paradigm for real-time robot manipulation, enabling the next action chunk to be predicted while the current one is being executed. While this approach achieves real-time responsiveness, naive integration often results in execution failure. Previous methods attributed this failure to inter-chunk discontinuity and developed test-time algorithms to smooth chunk boundaries. In contrast, we identify another critical yet overlooked factor: intra-chunk inconsistency, where the robot's executed action chunk partially misaligns with its current perception. To address this, we propose REMAC, which learns corrective adjustments on the pretrained policy through masked action chunking, enabling the policy to remain resilient under mismatches between intended actions and actual execution during asynchronous inference. In addition, we introduce a prefix-preserved sampling procedure to reinforce inter-chunk continuity. Overall, our method delivers more reliable policies without incurring additional latency. Extensive experiments in both simulation and real-world settings demonstrate that our method enables faster task execution, maintains robustness across varying delays, and consistently achieves higher completion rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。