基于激光雷达的端到端协同感知框架,提升车路协同下的目标检测与跟踪性能。
LiDAR-based End-to-end Temporal Perception for Vehicle-Infrastructure Cooperation
- 融合车端与路侧视角的时序信息,通过自注意力机制实现跨视角特征对齐。
- 引入校准误差补偿模块,使检测与追踪精度在基准上提升15%以上。
- 适合关注车路协同感知、自动驾驶多源融合的开发者与研究者。
时序感知指在时间序列中持续检测与追踪目标的能力,是自动驾驶系统的核心。单车辆感知受限于遮挡与盲区,而车路协同感知则面临传感器标定精度与定位准确性的挑战。为此,本文提出基于激光雷达的端到端协同感知框架LET-VIC。通过引入时序自注意力与车路交叉注意力模块,有效融合车辆与基础设施的时空信息;设计新型校准误差补偿(CEC)模块,缓解传感器错位问题,实现精准特征对齐。在V2X-Seq-SPD数据集上的实验表明,相较于LET-V,LET-VIC在mAP上提升15.0%,AMOTA提升17.3%。同时超越代表性检测后追踪模型(如V2VNet、FFNet、PointPillars),mAP至少提升13.7%,AMOTA至少提升13.1%(不计通信延迟),验证了多视角、时序信息与端到端训练的协同增益。所有代码将开源。
原文摘要 · Abstract (English)
Temporal perception, defined as the capability to detect and track objects across temporal sequences, serves as a fundamental component in autonomous driving systems. While single-vehicle perception systems encounter limitations, stemming from incomplete perception due to object occlusion and inherent blind spots, cooperative perception systems present their own challenges in terms of sensor calibration precision and positioning accuracy. To address these issues, we introduce LET-VIC, a LiDAR-based End-to-End Tracking framework for Vehicle-Infrastructure Cooperation (VIC). First, we employ Temporal Self-Attention and VIC Cross-Attention modules to effectively integrate temporal and spatial information from both vehicle and infrastructure perspectives. Then, we develop a novel Calibration Error Compensation (CEC) module to mitigate sensor misalignment issues and facilitate accurate feature alignment. Experiments on the V2X-Seq-SPD dataset demonstrate that LET-VIC significantly outperforms baseline models. Compared to LET-V, LET-VIC achieves +15.0% improvement in mAP and a +17.3% improvement in AMOTA. Furthermore, LET-VIC surpasses representative Tracking by Detection models, including V2VNet, FFNet, and PointPillars, with at least a +13.7% improvement in mAP and a +13.1% improvement in AMOTA without considering communication delays, showcasing its robust detection and tracking performance. The experiments demonstrate that the integration of multi-view perspectives, temporal sequences, or CEC in end-to-end training significantly improves both detection and tracking performance. All code will be open-sourced.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。