arXiv:2505.06980cs.ROcs.CV2025-05被引 2

通过车路协同扩展感知范围,提升复杂环境下自动驾驶可靠性。

VALISENS: A Validated Innovative Multi-Sensor System for Cooperative Automated Driving

  • 融合车载与路侧多传感器,实现车路协同感知
  • 行人感知能力提升18%,传感器监测准确率超97%
  • 适合智能交通系统、自动驾驶研发人员参考

可靠感知仍是连接式自动驾驶车辆(CAVs)在复杂现实环境中的关键挑战,光照变化和恶劣天气会降低传感性能。现有多传感器方案虽提升本地鲁棒性,但仍受限于感知范围有限、视线遮挡及单个车辆传感器故障。本文提出VALISENS,一种经验证的协作式感知系统,通过车联网(V2X)实现CAVs与智能基础设施间的协作,将多传感器融合拓展至单车之外。该系统整合车载与路侧的激光雷达、雷达、可见光相机和热成像相机,构建统一的多智能体感知框架。热成像相机增强在恶劣光照条件下的弱势道路使用者(VRUs)检测能力,路侧传感器减少遮挡并扩大有效感知范围。此外,集成传感器监控模块可实时评估传感器健康状态,在系统退化前检测异常。系统在专用实地测试平台实现并评估,实验结果表明,相比仅依赖车辆感知,行人情境意识提升最高达18%,传感器监控模块准确率超过97%,验证了其有效性及对未来协作式智能交通系统(C-ITS)应用的潜力。

原文摘要 · Abstract (English)

Reliable perception remains a key challenge for Connected Automated Vehicles (CAVs) in complex real-world environments, where varying lighting conditions and adverse weather degrade sensing performance. While existing multi-sensor solutions improve local robustness, they remain constrained by limited sensing range, line-of-sight occlusions, and sensor failures on individual vehicles. This paper introduces VALISENS, a validated cooperative perception system that extends multi-sensor fusion beyond a single vehicle through Vehicle-to-Everything (V2X)-enabled collaboration between Connected Automated Vehicles (CAVs) and intelligent infrastructure. VALISENS integrates onboard and roadside LiDARs, radars, RGB cameras, and thermal cameras within a unified multi-agent perception framework. Thermal cameras enhances the detection of Vulnerable Road Users (VRUs) under challenging lighting conditions, while roadside sensors reduce occlusions and expand the effective perception range. In addition, an integrated sensor monitoring module continuously assesses sensor health and detects anomalies before system degradation occurs. The proposed system is implemented and evaluated in a dedicated real-world testbed. Experimental results show that VALISENS improves pedestrian situational awareness by up to 18% compared with vehicle-only sensing, while the sensor monitoring module achieves over 97% accuracy, demonstrating its effectiveness and its potential to support future Cooperative Intelligent Transport Systems (C-ITS) applications.

自动驾驶车路协同多传感器融合感知系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。