arXiv:2607.16154cs.CVcs.SY2026-07中稿 · publication at the…

在边缘设备上实现相机与激光雷达融合,提升路口行人感知可靠性。

CLIFE: Camera-LiDAR Fusion Framework for Edge-Deployable Roadside VRU Perception

论文配图:CLIFE: Camera-LiDAR Fusion Framework for Edge-Deployable Roadside VRU Perception
图 1 · 摘自论文原文
  • 无需云端,单设备完成相机-激光雷达在线标定与轻量级后融合跟踪
  • 在Jetson AGX Thor上实现53.2帧/秒的实时处理,支持路口级应用
  • 适用于多路口部署,降低带宽与标定成本,适合城市交通管理部门

在遮挡、光照变化和复杂天气条件下,可靠感知道路弱势群体(VRUs)仍具挑战性,尤其在严格的边缘计算与延迟约束下。现有多传感器融合系统依赖云端或服务器级基础设施,导致实际路口部署存在缺口。本文提出CLIFE,一种原生面向边缘的相机-激光雷达融合框架,可在单个嵌入式设备上完成无目标在线标定与轻量级后融合跟踪,无需云卸载。CLIFE按需自适应优化相机-激光雷达对齐,并以每帧O(N log N)复杂度完成多传感器融合与轨迹关联。我们在查塔努加12个信号交叉口部署CLIFE,使用同步相机-激光雷达数据在代表性路口进行深入评估,涵盖昼夜及多种天气条件。实验表明,该融合架构显著提升了各传感器在不同环境与交通条件下的感知范围与鲁棒性。后融合核心在Jetson AGX Thor上运行达53.2 FPS,满足实时路口级应用的高吞吐需求。通过将感知中心置于边缘,CLIFE为下游安全应用提供可部署基础,同时降低多路口走廊运维的带宽与标定开销。

原文摘要 · Abstract (English)

Reliable roadside perception of vulnerable road users (VRUs) remains challenging under occlusions, variable lighting, and diverse weather conditions, particularly under strict edge-computing and latency constraints. Existing multi-sensor fusion systems rely on cloud or server-grade infrastructure, creating a deployment gap at real-world intersections. We present CLIFE, an edge-native camera-LiDAR fusion framework that integrates targetless online calibration and lightweight late-fusion tracking entirely on a single embedded device, without cloud offloading. CLIFE adaptively refines camera-LiDAR alignment on demand and performs multi-sensor fusion and track association with O(N log N) per-frame cost. We deploy CLIFE across 12 signalized intersections in Chattanooga and conduct an in-depth evaluation at a representative intersection using synchronized camera-LiDAR data that spans diverse daytime, nighttime, and weather conditions. Our experiments demonstrate that the fusion architecture substantially enhances the perceptual range and robustness of the individual sensors under varied environmental and traffic conditions. The late-fusion core operates at 53.2 FPS on the Jetson AGX Thor, ensuring high throughput for real-time intersection-scale applications. By centering perception at the edge, CLIFE provides a deployable foundation for downstream safety applications, while reducing bandwidth and calibration overhead for agencies operating multi-intersection corridors.

多模态融合边缘计算自动驾驶路侧感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。