让机器人安全控制能实时适应新约束,只需一张示意图即可
AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Space
- 用图像编码表示安全约束,通过潜空间相似度动态调整安全边界
- 在仿真与真实机械臂上实现运行时自适应,性能不下降
- 无需预先设定规则,用户可随时指定新安全要求
近期研究证明,基于哈密顿-雅可比(HJ)可达性分析的通用安全控制方法可应用于世界模型的潜空间。然而,这些方法假设安全约束在部署前已知且固定,限制了其在不同场景下的适应能力。为此,我们提出一种约束参数化的潜空间安全过滤器,可在运行时根据用户指定的安全约束进行自适应调整。核心思想是通过图像编码表示约束,并利用潜空间中的相似性度量来定义安全边界。通过共形校准,系统可对逼近约束编码的程度进行精确控制,确保安全性。整个安全过滤器在世界模型的‘想象’中训练完成,将模型见过的任意图像视为潜在的测试时约束,从而实现对任意安全约束的运行时适配。在配备Franka机械臂的视觉控制任务的仿真与硬件实验中,验证了该方法能在不牺牲性能的前提下,通过用户指定的约束图像实现动态调整。视频演示见 https://any-safe.github.io
原文摘要 · Abstract (English)
Recent works have shown that foundational safe control methods, such as Hamilton-Jacobi (HJ) reachability analysis, can be applied in the latent space of world models. While this enables the synthesis of latent safety filters for hard-to-model vision-based tasks, they assume that the safety constraint is known a priori and remains fixed during deployment, limiting the safety filter's adaptability across scenarios. To address this, we propose constraint-parameterized latent safety filters that can adapt to user-specified safety constraints at runtime. Our key idea is to define safety constraints by conditioning on an encoding of an image that represents a constraint, using a latent-space similarity measure. The notion of similarity to failure is aligned in a principled way through conformal calibration, which controls how closely the system may approach the constraint representation. The parameterized safety filter is trained entirely within the world model's imagination, treating any image seen by the model as a potential test-time constraint, thereby enabling runtime adaptation to arbitrary safety constraints. In simulation and hardware experiments on vision-based control tasks with a Franka manipulator, we show that our method adapts at runtime by conditioning on the encoding of user-specified constraint images, without sacrificing performance. Video results can be found on https://any-safe.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。