用单目相机实现低成本安全驾驶鬼探区预测
DPGP: A Hybrid 2D-3D Dual Path Potential Ghost Probe Zone Prediction Framework for Safe Autonomous Driving
- 融合2D与3D特征,利用深度不连续性识别潜在危险区域
- 在12000张图像上验证,性能优于现有方法且无需特殊硬件
- 首次扩展至非车辆物体,适合自动驾驶与智能交通系统
现代机器人需在密集城市环境中与人类共存。核心挑战是‘鬼探’问题——行人或物体突然闯入行车路径。现有方案依赖车联万物(V2X)或非视距成像,但多数需要高算力或专用硬件,难以落地。此外,多数方法未明确解决该问题。为此,我们提出DPGP,一种仅使用单目相机进行训练与推理的2D-3D混合融合框架。通过无监督深度预测发现,鬼探区域常与深度突变处重合,但不同深度表示鲁棒性各异。为此,我们融合多种特征嵌入以提升预测能力。为验证方法,构建了包含12000张图像的标注数据集,经严格筛选与交叉验证确保准确性。实验表明,本框架在保持低成本的同时超越现有方法。据我们所知,这是首个将鬼探区预测拓展至非车辆物体的工作。代码与数据集将开源,供社区使用。
原文摘要 · Abstract (English)
Modern robots must coexist with humans in dense urban environments. A key challenge is the ghost probe problem, where pedestrians or objects unexpectedly rush into traffic paths. This issue affects both autonomous vehicles and human drivers. Existing works propose vehicle-to-everything (V2X) strategies and non-line-of-sight (NLOS) imaging for ghost probe zone detection. However, most require high computational power or specialized hardware, limiting real-world feasibility. Additionally, many methods do not explicitly address this issue. To tackle this, we propose DPGP, a hybrid 2D-3D fusion framework for ghost probe zone prediction using only a monocular camera during training and inference. With unsupervised depth prediction, we observe ghost probe zones align with depth discontinuities, but different depth representations offer varying robustness. To exploit this, we fuse multiple feature embeddings to improve prediction. To validate our approach, we created a 12K-image dataset annotated with ghost probe zones, carefully sourced and cross-checked for accuracy. Experimental results show our framework outperforms existing methods while remaining cost-effective. To our knowledge, this is the first work extending ghost probe zone prediction beyond vehicles, addressing diverse non-vehicle objects. We will open-source our code and dataset for community benefit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。