用可信推理提升机器人安全滤波的宽松度,保障人机交互安全。
Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics

- 基于置信区间预测,在运行时评估推理可靠性并动态调整安全过滤
- 在模拟人车交互中使安全滤波放宽30%以上,同时保证高概率安全
- 适合需要在线学习与高安全性的人机协作机器人系统
自主机器人在与人类交互时需在人为不确定性(如偏好、目标、能力、合作意愿)下做出安全且高效的决策。安全滤波是一种常用方法,因其模块化设计可分离安全与性能,使机器人在人类附近运行时影响最小。传统安全滤波仅作用于物理空间,忽略在线学习与适应能力;而最近提出的信念空间安全滤波(BeliefSF)通过闭环推理实时降低不确定性,从而减少保守性。然而,由于运行时推理误差和高维信念空间中的神经近似,为部署BeliefSF提供形式化安全保证仍具挑战。本文提出一种基于置信区间预测的算法,显式考虑运行时推理模块的可靠性,对BeliefSF进行高概率安全验证。该方法利用信念空间滤波结构,聚焦于推理可靠的区域,保持标准置信区间预测的简洁性和样本复杂度,但可验证更宽松的安全滤波。在模拟人-车交互基准测试中,本方法验证的安全滤波比标准置信区间预测基线显著更宽松。
原文摘要 · Abstract (English)
Autonomous robots that interact with people must make safe and efficient decisions under human-induced uncertainty, such as their preferences, goals, competency, and willingness to cooperate. Safety filters are a popular approach for ensuring safety in interactive robotics, since their modular design separates safety from performance, allowing robots to operate safely around people with minimal impact on task efficiency. While traditional safety filters typically operate only in the physical space, neglecting the robot's ability to learn and adapt online, the recently proposed belief-space safety filter (BeliefSF) reasons about robot safety in closed-loop with runtime inference that actively reduces the robot's uncertainty online, thereby reducing conservativeness in filtering. However, providing formal safety guarantees for robots deploying BeliefSF remains a significant challenge due to errors in runtime inference and neural approximation of safety filters required to handle the high dimensionality of belief spaces. In this paper, we propose an algorithmic approach to certify high-probability safety of BeliefSF using conformal prediction, while explicitly accounting for the reliability of the robot's runtime inference module. Our method leverages the structure of belief-space safety filtering by focusing verification on a region where inference is expected to be reliable. It preserves the simplicity and sample complexity of standard conformal prediction, yet can certify a substantially less conservative safety filter. Through a simulated human-vehicle interaction benchmark, we show that our approach verifies a significantly more permissive belief-space safety filter than a standard conformal prediction baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。