让机器人在未知环境中实时判断安全策略,自适应不同场景。
Contextual Safety Reasoning and Grounding for Open-World Robots
- 用视觉语言模型从图像中动态推断上下文安全规则
- 在无地图和先验知识下实现空间安全区域的精准控制
- 适合需要自适应安全决策的开放世界机器人应用
机器人正越来越多地部署于开放世界环境中,其安全行为依赖于具体情境:同一条走廊在拥挤或空旷、紧急或正常情况下需采取不同导航策略。传统安全方法依赖用户预设的固定约束,难以应对真实环境中的无限情境变化。本文提出CORE框架,实现无需预先环境知识(如地图或安全规范)的在线上下文推理、定位与执行。CORE利用视觉语言模型(VLM)从视觉观测中持续推断情境相关的安全规则,将这些规则在物理环境中进行定位,并通过控制屏障函数(CBF)实现空间定义的安全集。我们为CORE提供了考虑感知不确定性的概率安全保证,并在仿真与真实实验中验证其在未见环境中能有效执行情境适配的行为,显著优于缺乏在线上下文推理能力的现有语义安全方法。消融实验验证了理论保障的有效性,并强调了VLM推理与空间定位对新场景下情境安全的关键作用。更多资源详见 https://zacravichandran.github.io/CORE。
原文摘要 · Abstract (English)
Robots are increasingly operating in open-world environments where safe behavior depends on context: the same hallway may require different navigation strategies when crowded versus empty, or during an emergency versus normal operations. Traditional safety approaches enforce fixed constraints in user-specified contexts, limiting their ability to handle the open-ended contextual variability of real-world deployment. We address this gap via CORE, a safety framework that enables online contextual reasoning, grounding, and enforcement without prior knowledge of the environment (e.g., maps or safety specifications). CORE uses a vision-language model (VLM) to continuously reason about context-dependent safety rules directly from visual observations, grounds these rules in the physical environment, and enforces the resulting spatially-defined safe sets via control barrier functions. We provide probabilistic safety guarantees for CORE that account for perceptual uncertainty, and we demonstrate through simulation and real-world experiments that CORE enforces contextually appropriate behavior in unseen environments, significantly outperforming prior semantic safety methods that lack online contextual reasoning. Ablation studies validate our theoretical guarantees and underscore the importance of both VLM-based reasoning and spatial grounding for enforcing contextual safety in novel settings. We provide additional resources at https://zacravichandran.github.io/CORE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。