将语义风险嵌入距离场,实现单目视觉下的实时安全控制
Embedding Semantic Risk into Distance Fields and CBFs for Online Monocular Safe Control

- 用语义分割结果动态膨胀障碍物距离场,区分不同物体风险等级
- 系统在10-20Hz下运行,硬件实验验证了远程操控与自主导航的安全性
- 适合需要语义感知的机器人安全控制场景,如自动驾驶、服务机器人
我们提出一种在线单目感知到控制框架,将语义风险嵌入基于控制屏障函数(CBF)的安全导航与遥操作所用的距离场中。现有方法对所有障碍物使用相同的距离安全裕度,或仅在下游控制器中使用语义信息,未能将语义风险编码至空间表示。本框架通过将语义信息直接嵌入欧几里得有符号距离场(ESDF),在线推理障碍物几何与类别相关风险。基于基础模型的单目SLAM前端从RGB视频重建密集三维几何,每帧语义分割提供像素级类别标签,并融合进重建几何。生成的几何-语义表示转换为ESDF,其中语义标签识别安全相关区域,并在场计算前进行类别依赖膨胀。该语义感知的ESDF提供CBF控制器所需的局部距离值和空间梯度,类别依赖增益进一步调节控制器响应。大量仿真与硬件实验表明,系统可实现10–20 Hz的在线运行,并在遥操作与自主导航中展现语义感知的安全行为。
原文摘要 · Abstract (English)
We propose an online monocular perception-to-control framework that embeds semantic risk into the distance field used by Control Barrier Function (CBF)-based safe navigation and teleoperation. Many perception-based safety filters assign the same distance-based safety margin to all mapped obstacles or use semantics only as a downstream controller adjustment, rather than encoding semantic risk in the spatial representation. Our framework instead reasons online about obstacle geometry and class-dependent risk by embedding semantic information directly into the Euclidean Signed Distance Field (ESDF). This design encodes semantic risk before control optimization, so high-risk objects exert a larger spatial influence in the safety field while retaining efficient ESDF queries at runtime. Specifically, a foundation-model-based SLAM front end reconstructs dense 3-D geometry from monocular RGB video, while per-frame semantic segmentation provides pixel-level class labels that are fused into the reconstructed geometry. The resulting geometric-semantic representation is then converted into an ESDF, where semantic labels identify safety-relevant regions and impose class-dependent inflation before field computation. The semantic-aware ESDF provides the local distance values and spatial derivatives required by the CBF controller, while class-dependent gains further regulate the controller response. Extensive simulation and hardware experiments demonstrate online operation at 10--20 Hz and semantic-aware safe behavior in both teleoperation and autonomous navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。