arXiv:2605.01195cs.RO2026-05

为模仿学习策略提供运行时安全监测,防止因微小扰动导致任务失败。

TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies

论文配图:TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies
图 1 · 摘自论文原文
  • 用三个通用指标构建连续安全评分函数,判断状态动作是否安全。
  • 在真实机器人上实现95%以上任务成功率,显著优于原策略的不足30%。
  • 适合需要高可靠性的工业自动化场景,尤其对敏感操作有严格要求。

近期模仿学习(IL)算法如流匹配和扩散策略在复杂操作任务中表现优异,但其对初始条件极度敏感且存在不可消除的近似误差,导致任务执行过程中漂移累积,即使在训练分布内也常失败。这使得在实际部署中面临严重安全隐患。安全部署的前提是让策略能自主判断能否按示范方式完成任务。本文提出TAIL-Safe,一种可识别训练后策略安全执行区域的原理性方法。该方法构建一个李普希茨连续的Q值函数,基于可视性、可识别性和可抓取性三个短期通用标准,将状态-动作对映射为长期安全得分。该函数的零上水平集刻画了经验上的控制不变集。当主策略提出的安全边界外的动作时,借鉴Nagumo定理设计恢复机制,通过梯度上升回溯至安全区域。为训练该Q函数,我们利用高保真度数字孪生技术(基于高斯点云)系统化采集失败数据,避免物理硬件风险。在Franka Emika机器人上的实验表明,原本在运行时扰动下失败率超70%的流匹配策略,在引入TAIL-Safe后任务成功率提升至95%以上。

原文摘要 · Abstract (English)

Recent imitation learning (IL) algorithms such as flow-matching and diffusion policies demonstrate remarkable performance in learning complex manipulation tasks. However, these policies often fail even when operating within their training distribution due to extreme sensitivity to initial conditions and irreducible approximation errors that lead to compounding drift. This makes it unsafe to deploy IL policies in the field where out-of-distribution scenarios are prevalent. A prerequisite for safe deployment is enabling the policy to determine whether it can execute a task the way it was learned from demonstrations. This paper presents TAIL-Safe, a principled approach to identify, for a trained IL policy, a safe set from where the policy empirically succeeds in completing the learned task. We propose a Lipschitz-continuous Q-value function that maps state-action pairs to a long-term safety score based on three short-term task-agnostic criteria: visibility, recognizability, and graspability. The zero-superlevel set of this function characterizes an empirical control invariant set over state-action pairs. When the nominal policy proposes an action outside this set, we apply a recovery mechanism inspired by Nagumo's theorem that uses gradient ascent to the Q-function to steer the policy back to safety. To learn this Q-function, we construct a high-fidelity digital twin using Gaussian Splatting that enables systematic collection of failure data without risk to physical hardware. Experiments with a Franka Emika robot demonstrate that flow-matching policies, which fail under run-time perturbations, achieve consistent task success when guided by the proposed TAIL-Safe.

模仿学习安全监控数字孪生机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。