新安全滤波器让驾驶员更安心,且不抢方向盘。
Safety with Agency: Human-Centered Safety Filter with Application to AI-Assisted Motorsports
- 用神经网络学安全值函数,实时生成平滑干预
- 实测提升安全与满意度,同时保持驾驶自主性
- 适合高风险人机协同场景,如赛车辅助
我们提出一种以人为中心的安全滤波器(HCSF),用于共享自主系统,显著提升系统安全性而不损害人类自主性。该HCSF基于神经安全价值函数,通过黑箱交互可扩展地学习,并在部署时用于执行一种新型的状态-动作控制屏障函数(Q-CBF)安全约束。由于Q-CBF无需系统动力学知识即可完成合成与运行时安全监控和干预,本方法可直接应用于复杂、黑箱的共享自主系统。特别地,基于CBF的干预对人类操作修改极小且平滑,避免了传统安全滤波器在最后时刻的剧烈修正。我们在真实用户研究中验证了该方法,使用具有黑箱动力学特性的高保真赛车模拟器Assetto Corsa,评估其在“极限驾驶”场景下的鲁棒性。对比有无辅助及传统安全滤波器的轨迹数据与驾驶员感知,结果表明:1)相比无辅助,该HCSF在不牺牲人类自主性或舒适度的前提下,同时提升安全性和用户满意度;2)相比传统安全滤波器,该方法进一步提升了人类自主性、舒适度与满意度,同时保持鲁棒性。
原文摘要 · Abstract (English)
We propose a human-centered safety filter (HCSF) for shared autonomy that significantly enhances system safety without compromising human agency. Our HCSF is built on a neural safety value function, which we first learn scalably through black-box interactions and then use at deployment to enforce a novel state-action control barrier function (Q-CBF) safety constraint. Since this Q-CBF safety filter does not require any knowledge of the system dynamics for both synthesis and runtime safety monitoring and intervention, our method applies readily to complex, black-box shared autonomy systems. Notably, our HCSF's CBF-based interventions modify the human's actions minimally and smoothly, avoiding the abrupt, last-moment corrections delivered by many conventional safety filters. We validate our approach in a comprehensive in-person user study using Assetto Corsa-a high-fidelity car racing simulator with black-box dynamics-to assess robustness in "driving on the edge" scenarios. We compare both trajectory data and drivers' perceptions of our HCSF assistance against unassisted driving and a conventional safety filter. Experimental results show that 1) compared to having no assistance, our HCSF improves both safety and user satisfaction without compromising human agency or comfort, and 2) relative to a conventional safety filter, our proposed HCSF boosts human agency, comfort, and satisfaction while maintaining robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。