arXiv:2608.04776cs.AI2026-08

用神经语义场+分层风险树,实现单目摄像头下的实时高精度风险评估。

NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment

论文配图:NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment
图 1 · 摘自论文原文
  • 融合神经语义场与分层风险树,从单目图像中建模多智能体交互风险。
  • 在真实数据集上实现接近顶尖的碰撞时间估计精度和风险定位能力。
  • 无需重新训练即可通过基础模型先验提升现实场景适应性,适合自动驾驶安全系统。

准确评估和预测安全关键场景中的风险对自动驾驶系统至关重要。尽管现有研究在碰撞预测方面取得进展,但仅凭单目视觉输入准确量化风险仍面临挑战,主要源于多智能体交互的复杂动态及现实环境中的固有不确定性。为此,我们提出NSF-HRPT框架,结合学习型感知与结构化推理,实现定量风险评估。该方法采用神经语义场(NSF)从仿真数据中学习场景语义、轨迹预测及概率性碰撞时间(TTC)分布。推理阶段,预训练的NSF作为先验,驱动分层风险感知树(HRPT),支持高效并行计算与多智能体风险的空间推理。此外,引入Sim2Real增强策略,通过基础模型先验提升真实世界适用性,无需重训练。大量实验表明,该框架在合成基准上达到最先进水平,在真实数据集上也实现了具有竞争力的近最先进性能,涵盖TTC估计准确率与风险定位精度。所提方法为单目摄像头输入下的实时风险感知提供了有效解决方案。

原文摘要 · Abstract (English)

The ability to accurately assess and anticipate risks in safety-critical scenarios is crucial for autonomous driving systems. While existing research has made progress in collision prediction, accurately quantifying risk levels from monocular vision inputs remains challenging due to the complex dynamics of multi-agent interactions and the inherent uncertainty in real-world environments. To address these challenges, we present NSF-HRPT, a novel framework that combines learning-based perception with structured reasoning for quantitative risk assessment. Our approach features a Neural Semantic Field (NSF) that learns to model scene semantics, trajectory predictions, and probabilistic Time-to-Collision (TTC) distributions from simulation data. During inference, the pre-trained NSF serves as a prior for our Hierarchical Risk Perception Tree (HRPT), which enables efficient parallel computation and spatial reasoning about multi-agent risks. Additionally, we introduce a Sim2Real enhancement strategy that improves real-world applicability without retraining by incorporating priors from foundation models. Extensive evaluations demonstrate that our framework achieves state-of-the-art performance on synthetic benchmarks and delivers competitive, near-state-of-the-art results on real-world datasets for both TTC estimation accuracy and risk localization precision. The proposed method provides an effective solution for real-time risk awareness from monocular camera inputs.

自动驾驶风险评估单目视觉神经语义场

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。