arXiv:2412.16889cs.CV2024-12TPAMI被引 16

提出无需鸟瞰图的3D车道检测方法,直接从前视图预测更精准的3D车道。

Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regression

  • 用可自适应生成的稀疏3D锚点作为车道结构表示,直接从前视图特征预测。
  • 在三个主流数据集上超越现有最佳方法,显著提升3D车道检测精度。
  • 适合自动驾驶中需要高精度3D车道理解的场景,尤其关注前端感知系统优化。

本文聚焦于单目3D车道检测这一挑战性任务。以往方法通常通过逆透视映射(IPM)将前视图(FV)图像或特征转换至鸟瞰图(BEV)空间进行车道检测,但其依赖平坦地面假设且在BEV表示中丢失上下文信息,导致3D信息估计不准确。尽管已有研究尝试跳过BEV空间,直接从FV表示预测3D车道,但由于缺乏对3D车道的结构化建模,性能仍落后于基于BEV的方法。为此,本文提出一种新型无BEV方法Anchor3DLane++,将3D车道锚点定义为结构化表示,并直接从前视图特征进行预测。设计了原型自适应锚点生成(PAAG)模块,动态生成样本自适应的稀疏3D锚点。引入等宽(EW)损失,利用车道平行特性进行正则化。此外,基于Anchor3DLane++探索了相机-激光雷达融合,以融合互补信息。在三个主流3D车道检测基准上的大量实验表明,Anchor3DLane++优于此前最先进方法。代码已开源:https://github.com/tusen-ai/Anchor3DLane。

原文摘要 · Abstract (English)

In this paper, we focus on the challenging task of monocular 3D lane detection. Previous methods typically adopt inverse perspective mapping (IPM) to transform the Front-Viewed (FV) images or features into the Bird-Eye-Viewed (BEV) space for lane detection. However, IPM's dependence on flat ground assumption and context information loss in BEV representations lead to inaccurate 3D information estimation. Though efforts have been made to bypass BEV and directly predict 3D lanes from FV representations, their performances still fall behind BEV-based methods due to a lack of structured modeling of 3D lanes. In this paper, we propose a novel BEV-free method named Anchor3DLane++ which defines 3D lane anchors as structural representations and makes predictions directly from FV features. We also design a Prototype-based Adaptive Anchor Generation (PAAG) module to generate sample-adaptive sparse 3D anchors dynamically. In addition, an Equal-Width (EW) loss is developed to leverage the parallel property of lanes for regularization. Furthermore, camera-LiDAR fusion is also explored based on Anchor3DLane++ to leverage complementary information. Extensive experiments on three popular 3D lane detection benchmarks show that our Anchor3DLane++ outperforms previous state-of-the-art methods. Code is available at: https://github.com/tusen-ai/Anchor3DLane.

3D车道检测单目视觉结构化建模自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。