arXiv:2605.25537cs.RO2026-05被引 1

提出软化版实时分块训练,提升动作连续性与执行效率。

Action-Prior Denoising for Smooth Real-Time Chunking

论文配图:Action-Prior Denoising for Smooth Real-Time Chunking
图 1 · 摘自论文原文
  • 用动作先验去噪构建部分修复的重叠动作,模拟真实延迟场景。
  • 中等窗口下动作变化率和抖动分别降低9.1%与9.6%,接近硬约束表现。
  • 适合需低延迟、高平滑性的机器人实时控制任务。

实时分块(RTC)通过将新动作块基于前一块已确定动作进行条件生成,实现推理延迟下的分块动作策略运行。训练时RTC通过模拟延迟学习,避免部署时昂贵的引导,但其二值前缀掩码将所有非前缀标记视为完全自由,未能建模异步执行:早期重叠动作已固定,后期重叠动作虽可编辑但仍应贴近先前计划。本文提出软化版RTC,基于动作先验去噪的训练时泛化方法。它从部分去噪状态构造被破坏的重叠标记,并在推理时通过轻量级逐标记融合规则注入对齐的前一区块作为先验。在12个公开大型Kinetix级别上,短软窗口的总体解决率接近硬训练时RTC(0.809 vs. 0.815),中等窗口在高延迟下动作差值与抖动分别相对降低9.1%与9.6%。两种变体均保持近似原生推理时间,优于推理时RTC基线。初步真实机器人分拣实验表明,训练时RTC能提升完成度,且软化版在命令动作有限差分指标上优于其他测试策略。

原文摘要 · Abstract (English)

Real-time chunking (RTC) lets chunked action policies operate under inference delay by conditioning a newly generated action chunk on actions already committed by the previous chunk. Training-time RTC simulates this delay during learning and avoids expensive guidance at deployment, but its binary prefix mask treats all non-prefix tokens as fully unconstrained. This under-models asynchronous execution: early overlap actions are fixed, while later overlap actions remain editable but should still stay close to the previous plan. We propose Soft RTC, a training-time RTC generalization based on action-prior denoising. Soft RTC constructs corrupted overlap tokens from partially denoised states instead of pure noise and injects the aligned previous chunk as the same prior during inference through a lightweight token-wise blending rule. On the 12 released large Kinetix levels, a short soft window nearly matches hard training-time RTC in overall solve rate (0.809 vs. 0.815), while a medium window reduces high-delay action delta and jerk by 9.1% and 9.6% relative to hard RTC. Both variants keep near-naive runtime, unlike inference-time RTC baselines. A small preliminary real-robot sorting study provides additional evidence that training-time RTC can improve completion and that Soft RTC gives the lowest commanded-action finite-difference metrics among the tested policies.

实时控制动作规划机器人强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。