arXiv:2502.00935cs.ROcs.LG2025-02被引 71

用隐空间分析让机器人避免看不见的危险,如翻倒物品或洒落东西。

Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis

论文配图:Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis
图 1 · 摘自论文原文
  • 在生成模型的隐空间中进行安全分析,直接处理图像等原始观测数据
  • 无需人工编写安全规则,可自动识别并防止复杂非碰撞风险
  • 适用于模仿学习、遥控等多种策略,实现在仿真和硬件上的安全防护

汉密尔顿-雅克比(HJ)可达性是一种严格的数学框架,可使机器人同时检测不安全状态并生成防止未来失败的动作。尽管理论上可用于非线性系统和非凸约束的安全控制器设计,但实践中受限于手工构建的低维状态空间碰撞规避约束及第一性原理动力学。本文旨在将安全控制扩展至难以甚至无法手工定义的故障场景,但可通过高维观测直观识别,例如袋子内容物洒出。我们提出隐空间安全过滤器(Latent Safety Filters),通过在生成世界模型的隐空间中执行可达性分析,直接对原始观测数据(如RGB图像)进行安全分析,自动计算保安全动作,无需显式恢复演示。方法利用多样化的机器人观测-动作数据(包括成功、随机探索和不安全示范)学习世界模型,将约束定义转化为该模型隐空间中的分类问题。在仿真与硬件实验中,我们对任意策略(从模仿学习策略到直接遥操作)应用隐空间安全过滤器近似,有效防范了如弗兰卡研究3机械臂洒出袋中物品或推倒杂乱物体等复杂安全威胁。

原文摘要 · Abstract (English)

Hamilton-Jacobi (HJ) reachability is a rigorous mathematical framework that enables robots to simultaneously detect unsafe states and generate actions that prevent future failures. While in theory, HJ reachability can synthesize safe controllers for nonlinear systems and nonconvex constraints, in practice, it has been limited to hand-engineered collision-avoidance constraints modeled via low-dimensional state-space representations and first-principles dynamics. In this work, our goal is to generalize safe robot controllers to prevent failures that are hard--if not impossible--to write down by hand, but can be intuitively identified from high-dimensional observations: for example, spilling the contents of a bag. We propose Latent Safety Filters, a latent-space generalization of HJ reachability that tractably operates directly on raw observation data (e.g., RGB images) to automatically compute safety-preserving actions without explicit recovery demonstrations by performing safety analysis in the latent embedding space of a generative world model. Our method leverages diverse robot observation-action data of varying quality (including successes, random exploration, and unsafe demonstrations) to learn a world model. Constraint specification is then transformed into a classification problem in the latent space of the learned world model. In simulation and hardware experiments, we compute an approximation of Latent Safety Filters to safeguard arbitrary policies (from imitation- learned policies to direct teleoperation) from complex safety hazards, like preventing a Franka Research 3 manipulator from spilling the contents of a bag or toppling cluttered objects.

机器人安全隐空间可达性分析生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。