arXiv:2409.08688cs.CVcs.RO2024-09被引 5

用逆透视映射构建通用在线高精地图,提升跨摄像头泛化能力。

GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction

  • 基于逆透视映射解耦相机参数,设计三支路协同架构
  • 在多个数据集上超越当前最佳方法,推理速度快
  • 适合需要快速适配新摄像头的自动驾驶地图系统

在线高精地图因其灵活更新和低成本维护成为自动驾驶首选,但现有方法将视觉传感器参数嵌入训练,导致在不同传感器上泛化能力下降。受逆透视映射(IPM)解耦相机参数的启发,本文提出通用地图生成框架GenMapping,采用主干与双辅助分支结构:主分支在状态空间模型下学习鲁棒全局特征;密集视角分支捕捉静态与动态物体相关性,稀疏先验分支引入OpenStreetMap(OSM)先验知识;三重增强融合模块协同整合各分支空间特征。为进一步提升泛化能力,采用跨视图地图学习(CVML)在公共空间中实现联合学习,并引入双向数据增强(BiDA)模块减少对数据集依赖。大量实验表明,该模型在语义地图与矢量化地图任务上均优于现有最优方法,同时保持快速推理速度。

原文摘要 · Abstract (English)

Online High-Definition (HD) maps have emerged as the preferred option for autonomous driving, overshadowing the counterpart offline HD maps due to flexible update capability and lower maintenance costs. However, contemporary online HD map models embed parameters of visual sensors into training, resulting in a significant decrease in generalization performance when applied to visual sensors with different parameters. Inspired by the inherent potential of Inverse Perspective Mapping (IPM), where camera parameters are decoupled from the training process, we have designed a universal map generation framework, GenMapping. The framework is established with a triadic synergy architecture, including principal and dual auxiliary branches. When faced with a coarse road image with local distortion translated via IPM, the principal branch learns robust global features under the state space models. The two auxiliary branches are a dense perspective branch and a sparse prior branch. The former exploits the correlation information between static and moving objects, whereas the latter introduces the prior knowledge of OpenStreetMap (OSM). The triple-enhanced merging module is crafted to synergistically integrate the unique spatial features from all three branches. To further improve generalization capabilities, a Cross-View Map Learning (CVML) scheme is leveraged to realize joint learning within the common space. Additionally, a Bidirectional Data Augmentation (BiDA) module is introduced to mitigate reliance on datasets concurrently. A thorough array of experimental results shows that the proposed model surpasses current state-of-the-art methods in both semantic mapping and vectorized mapping, while also maintaining a rapid inference speed. The source code will be publicly available at https://github.com/lynn-yu/GenMapping.

高精地图逆透视自动驾驶泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。