arXiv:2411.02747cs.CV2024-11被引 2

提升单目3D检测精度,尤其改善小物体识别与尺度适应性。

Efficient Feature Aggregation and Scale-Aware Regression for Monocular 3D Object Detection

  • 用全局注意力+轻量卷积融合多尺度特征,增强小物体感知。
  • 引入动态感受野偏移,使定位更精准,小物体检测性能提升12.6%。
  • 适合自动驾驶场景中高精度单目3D目标检测任务。

单目3D目标检测因结构简单、成本低而备受关注。现有方法多沿用传统2D检测范式,先定位物体中心,再通过邻近特征预测3D属性。然而,这些方法主要依赖逐级跨尺度特征聚合,仅关注局部信息,易缺乏全局感知且忽略小尺度物体。此外,由于不同场景和深度下物体尺度差异大,感受野不准确常导致背景噪声干扰,降低特征表示质量。为此,本文提出MonoASRH框架,包含高效混合特征聚合模块(EH-FAM)和自适应尺度感知3D回归头(ASRH)。EH-FAM采用带全局感受野的多头注意力提取小物体语义特征,并利用轻量卷积模块高效聚合多尺度视觉特征。ASRH编码2D边界框尺寸,通过尺度-语义特征融合模块将尺度特征与EH-FAM聚合的语义特征融合,引导其学习动态感受野偏移,将尺度先验融入3D位置预测以提升尺度感知能力。在KITTI和Waymo数据集上的大量实验表明,MonoASRH达到当前最优性能。

原文摘要 · Abstract (English)

Monocular 3D object detection has attracted great attention due to simplicity and low cost. Existing methods typically follow conventional 2D detection paradigms, first locating object centers and then predicting 3D attributes via neighboring features. However, these methods predominantly rely on progressive cross-scale feature aggregation and focus solely on local information, which may result in a lack of global awareness and the omission of small-scale objects. In addition, due to large variation in object scales across different scenes and depths, inaccurate receptive fields often lead to background noise and degraded feature representation. To address these issues, we introduces MonoASRH, a novel monocular 3D detection framework composed of Efficient Hybrid Feature Aggregation Module (EH-FAM) and Adaptive Scale-Aware 3D Regression Head (ASRH). Specifically, EH-FAM employs multi-head attention with a global receptive field to extract semantic features for small-scale objects and leverages lightweight convolutional modules to efficiently aggregate visual features across different scales. The ASRH encodes 2D bounding box dimensions and then fuses scale features with the semantic features aggregated by EH-FAM through a scale-semantic feature fusion module. The scale-semantic feature fusion module guides ASRH in learning dynamic receptive field offsets, incorporating scale priors into 3D position prediction for better scale-awareness. Extensive experiments on the KITTI and Waymo datasets demonstrate that MonoASRH achieves state-of-the-art performance.

单目3D检测尺度感知特征融合自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。