arXiv:2508.04033cs.CVeess.SP2025-08中稿 · IEEE/RSJ Internati…被引 3

用摄像头和雷达融合定位挡车后突然出现的行人,提升城市道路安全。

Radar-Based NLoS Pedestrian Localization for Darting-Out Scenarios Near Parked Vehicles with Camera-Assisted Point Cloud Interpretation

  • 通过图像分割识别停靠车辆,结合雷达点云精确定位遮挡区域。
  • 在真实城市道路测试中显著提前发现突发性行人,提升预警能力。
  • 适合智能驾驶、自动驾驶系统在复杂停车环境下做行人感知。

城市道路中因路边停车形成的非视距(NLoS)盲区对交通安全构成重大挑战,尤其在行人突然从停放车辆间窜出时更为突出。毫米波技术利用衍射与反射可探测这些遮挡区域,已有研究展示了其在检测被遮挡物体方面的潜力。然而,现有方法多依赖预设空间信息或假设简单墙面反射,泛化能力与实际应用受限。尤其当行人从车辆间突然出现时,由于停靠车辆具有动态性且可能移动,卫星地图等预设数据难以反映实时路况,导致传感器误判。为此,本文提出一种融合单目相机图像与二维雷达点云(2D radar PCD)的NLoS行人定位框架。该方法首先通过图像分割检测停靠车辆,估计深度以推断近似空间特征,并进一步利用2D雷达点云数据进行空间信息精细化修正。在真实城市道路环境中的实验验证表明,所提方法能有效实现早期行人探测,显著增强道路安全性。补充材料详见 https://hiyeun.github.io/NLoS/。

原文摘要 · Abstract (English)

The presence of Non-Line-of-Sight (NLoS) blind spots resulting from roadside parking in urban environments poses a significant challenge to road safety, particularly due to the sudden emergence of pedestrians. mmWave technology leverages diffraction and reflection to observe NLoS regions, and recent studies have demonstrated its potential for detecting obscured objects. However, existing approaches predominantly rely on predefined spatial information or assume simple wall reflections, thereby limiting their generalizability and practical applicability. A particular challenge arises in scenarios where pedestrians suddenly appear from between parked vehicles, as these parked vehicles act as temporary spatial obstructions. Furthermore, since parked vehicles are dynamic and may relocate over time, spatial information obtained from satellite maps or other predefined sources may not accurately reflect real-time road conditions, leading to erroneous sensor interpretations. To address this limitation, we propose an NLoS pedestrian localization framework that integrates monocular camera image with 2D radar point cloud (PCD) data. The proposed method initially detects parked vehicles through image segmentation, estimates depth to infer approximate spatial characteristics, and subsequently refines this information using 2D radar PCD to achieve precise spatial inference. Experimental evaluations conducted in real-world urban road environments demonstrate that the proposed approach enhances early pedestrian detection and contributes to improved road safety. Supplementary materials are available at https://hiyeun.github.io/NLoS/.

行人检测雷达融合智能驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。