用时空语义增强雷达检测,提升自动驾驶感知精度。
Mask-RadarNet: Enhancing Transformer With Spatial-Temporal Semantic Context for Radar Object Detection in Autonomous Driving

- 融合卷积与注意力机制,替代传统Transformer结构。
- 在CRUW数据集上准确率优于现有方法,参数更少。
- 适合资源受限的车载系统,兼顾性能与效率。
作为成本低且鲁棒性强的技术,汽车雷达近年来持续进步,成为自动驾驶中相机和激光雷达的有力补充。富含语义信息的射频数据日益受到关注。当前多数基于雷达的模型以射频图像序列作为输入,但这些模型严重依赖卷积神经网络,编码阶段忽略了时空语义上下文。为此,我们提出一种名为Mask-RadarNet的新模型,充分挖掘输入雷达数据中的层次化语义特征。该模型采用交错卷积与注意力操作的组合,替代传统Transformer架构,并引入补丁位移机制,在时间维度上以特定马赛克模式移动部分补丁,实现高效时空特征学习,同时降低时空建模的计算开销。为捕捉时空语义上下文,我们在编码器中设计了类别掩码注意力模块(CMAM),并加入轻量级辅助解码器,聚合来自CMAM的先验图。在CRUW数据集上的实验表明,所提方法在保持较低计算复杂度和较少参数的同时,显著提升了自动驾驶中目标检测的识别准确率,优于多个前沿雷达检测算法。
原文摘要 · Abstract (English)
As a cost-effective and robust technology, automotive radar has seen steady improvement during the last years, making it an appealing complement to commonly used sensors like camera and LiDAR in autonomous driving. Radio frequency data with rich semantic information are attracting more and more attention. Most current radar-based models take radio frequency image sequences as the input. However, these models heavily rely on convolutional neural networks and leave out the spatial-temporal semantic context during the encoding stage. To solve these problems, we propose a model called Mask-RadarNet to fully utilize the hierarchical semantic features from the input radar data. Mask-RadarNet exploits the combination of interleaved convolution and attention operations to replace the traditional architecture in transformer-based models. In addition, patch shift is introduced to the Mask-RadarNet for efficient spatial-temporal feature learning. By shifting part of patches with a specific mosaic pattern in the temporal dimension, Mask-RadarNet achieves competitive performance while reducing the computational burden of the spatial-temporal modeling. In order to capture the spatial-temporal semantic contextual information, we design the class masking attention module (CMAM) in our encoder. Moreover, a lightweight auxiliary decoder is added to our model to aggregate prior maps generated from the CMAM. Experiments on the CRUW dataset demonstrate the superiority of the proposed method to some state-of-the-art radar-based object detection algorithms. With relatively lower computational complexity and fewer parameters, the proposed Mask-RadarNet achieves higher recognition accuracy for object detection in autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。