通过模拟物体与车辆的未来关系,直接定位自动驾驶中的风险源。
RiskWorld: Object-Centric Latent World Modeling for Autonomous Driving Risk Identification

- 基于物体中心的潜空间建模,预测每个物体与自车的未来关系。
- 在RiskBench上达到63.0%的最高F1和2.1%最低误报率。
- 适合需要高精度风险定位的自动驾驶系统研发者。
自动驾驶风险识别旨在判断哪个观测物体可能对自车构成安全威胁。现有方法通常预测场景级事故、间接推断风险物体或在轨迹预测后进行几何检查,未能直接利用预测的自车-物体关系进行风险源定位。我们提出RiskWorld,一种物体中心的潜空间世界模型,通过模拟每个候选物体相对于自车的未来演化来识别风险。RiskWorld结合预训练的预测视频表示与结构化的自车-物体历史,对观测到的交互进行上下文建模,并使用类似RSSM的潜动态将关系感知的物体状态向前滚动。它将滚动结果解码为物体级别的风险评分,辅以未来的相对关系和时间风险的辅助预测。推理仅依赖当前时刻的观测,而日志中的未来序列提供训练监督。在RiskBench数据集上,RiskWorld实现63.0%的最高整体F1和2.1%的最低误报率。进一步分析表明,学习到的滚动能提前捕捉物体级风险的演化,且在过滤观测下仍保留规划关键信息。
原文摘要 · Abstract (English)
Autonomous driving risk identification aims to determine which observed object is likely to become safety-critical to the ego vehicle. Existing approaches typically predict scene-level accidents, infer risk objects indirectly from ego behavior, or apply geometric checks after trajectory forecasting, without directly using predicted ego--object relations for risk-source localization. We propose RiskWorld, an object-centric latent world model that identifies risk from the imagined evolution of each candidate relative to the ego vehicle. RiskWorld combines pretrained predictive video representations with structured ego--object histories, contextualizes observed interactions, and rolls relation-aware object states into the future using RSSM-style latent dynamics. It decodes the rollout into object-level risk scores, supported by auxiliary future-relation and temporal-risk predictions. Inference uses only observations up to the current time, while logged futures provide training supervision. On RiskBench, RiskWorld achieves the best overall F1 of 63.0\% and the lowest false-alarm rate of 2.1\%. Further analyses show that the learned rollout captures the evolution of object-level risk before critical events, while RiskWorld's selections preserve planning-critical information under filtered observation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。