用3D地图定位交通摄像头,提升复杂路口的精准匹配。
TrafficLoc: Localizing Traffic Surveillance Cameras in 3D Scenes
- 分步匹配:先粗后精,结合几何注意力聚焦对应区域。
- 在模拟数据集上提升86%,真实场景也能良好泛化。
- 适合自动驾驶、城市规划等需要精确摄像头定位的场景。
本文针对三维参考地图中交通摄像头定位问题,提出新型图像到点云配准方法TrafficLoc,采用由粗到细的匹配策略。为解决真实交叉口数据集稀缺问题,首次构建了包含75个城乡交叉口的仿真数据集Carla Intersection。研究发现,现有跨模态配准方法在大视角差异下表现不佳,尤其在交通交叉口。为此,TrafficLoc引入几何引导注意力损失(GAL),仅关注不同视角下的对应几何区域进行2D-3D特征融合;为缓解图像块与点群间特征不一致问题,提出组内-组间对比学习(ICL)以增强同模态内部特征区分性,并设计基于soft-argmax的密集训练对齐(DTA)优化位置回归。大量实验表明,TrafficLoc在Carla Intersection上相较最先进方法性能提升最高达86%,且可良好迁移到真实数据;同时在KITTI和NuScenes数据集上也取得新最优结果,验证了其在车载与交通摄像头场景中的普适优势。
原文摘要 · Abstract (English)
We tackle the problem of localizing traffic cameras within a 3D reference map and propose a novel image-to-point cloud registration (I2P) method, TrafficLoc, in a coarse-tofine matching fashion. To overcome the lack of large-scale real-world intersection datasets, we first introduce Carla Intersection, a new simulated dataset with 75 urban and rural intersections in Carla. We find that current I2P methods struggle with cross-modal matching under large viewpoint differences, especially at traffic intersections. TrafficLoc thus employs a novel Geometry-guided Attention Loss (GAL) to focus only on the corresponding geometric regions under different viewpoints during 2D-3D feature fusion. To address feature inconsistency in paired image patch-point groups, we further propose Inter-intra Contrastive Learning (ICL) to enhance separating 2D patch/3D group features within each intra-modality and introduce Dense Training Alignment (DTA) with soft-argmax for improving position regression. Extensive experiments show our TrafficLoc greatly improves the performance over the SOTA I2P methods (up to 86%) on Carla Intersection and generalizes well to real-world data. TrafficLoc also achieves new SOTA performance on KITTI and NuScenes datasets, demonstrating the superiority across both in-vehicle and traffic cameras. Our project page is publicly available at https://tum-luk.github.io/projects/trafficloc/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。