用新方法提升自动驾驶3D目标检测精度与速度
RQR3D: Reparametrizing the regression targets for BEV-based 3D object detection
- 将旋转框转化为角点回归任务,避免角度损失不连续问题
- 在nuScenes上达67.5 NDS、59.7 mAP,误差更小
- 适合追求高精度与轻量化的自动驾驶感知系统
准确、快速且可靠的3D感知对自动驾驶至关重要。近年来,基于鸟瞰图(BEV)的感知方法因其更好的空间理解能力和更自然的规划输出,成为透视图方法的优越替代方案。现有BEV-based 3D目标检测方法通常采用角度表示法,直接估计旋转框的尺寸和方向。我们观察到,这与航空图像中的定向目标检测类似,而角度表示法在损失函数中存在不连续性。受此启发,我们提出受限四边形表示(RQR3D),通过回归包围旋转框的最小水平框及其角点偏移,将定向检测问题转化为关键点回归任务。我们在无锚点单阶段检测框架中应用RQR3D,取得当前最优性能,并验证其可兼容多种检测方法。此外,我们设计了一种简化雷达融合骨干网络,对雷达特征应用标准2D卷积,利用数据固有的2D结构实现高效且几何一致的处理,无需体素分组和稀疏卷积。在nuScenes数据集上的大量实验表明,尽管设计轻量,RQR3D仍实现了最先进的相机-雷达3D检测性能,达到67.5 NDS和59.7 mAP,且平移与方向误差显著降低,这对安全自动驾驶至关重要。
原文摘要 · Abstract (English)
Accurate, fast, and reliable 3D perception is essential for autonomous driving. Recently, bird's-eye view (BEV)-based perception approaches have emerged as superior alternatives to perspective-based solutions, offering enhanced spatial understanding and more natural outputs for planning. Existing BEV-based 3D object detection methods, typically using an angle-based representation, directly estimate the size and orientation of rotated bounding boxes. We observe that BEV-based 3D object detection is analogous to aerial oriented object detection, where angle-based methods are known to suffer from discontinuities in their loss functions. Drawing inspiration from this domain, we propose \textbf{R}estricted \textbf{Q}uadrilateral \textbf{R}epresentation to define \textbf{3D} regression targets. RQR3D regresses the smallest horizontal bounding box encapsulating the oriented box, along with the offsets between the corners of these two boxes, thereby transforming the oriented object detection problem into a keypoint regression task. We employ RQR3D within an anchor-free single-stage object detection method achieving state-of-the-art performance. We show that the proposed architecture is compatible with different object detection approaches. Furthermore, we introduce a simplified radar fusion backbone that applies standard 2D convolutions to radar features. This backbone leverages the inherent 2D structure of the data for efficient and geometrically consistent processing without over-parameterization, thereby eliminating the need for voxel grouping and sparse convolutions. Extensive evaluations on the nuScenes dataset show that RQR3D achieves SotA camera-radar 3D object detection performance despite its lightweight design, reaching 67.5 NDS and 59.7 mAP with reduced translation and orientation errors, which are crucial for safe autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。