针对室内多视角雷达检测,提出新型Transformer模型,精度显著提升。
RETR: Multi-View Radar Detection Transformer for Indoor Perception

- 基于DETR改进,引入深度优先位置编码和跨模态损失函数
- 在两个数据集上检测精度提升15.38点,实例分割指标提高11.91点
- 适合需要隐私保护与高可靠性的室内感知场景
由于车载成像雷达技术发展带来的成本下降,以及在火灾、烟雾等危险环境下更好的可靠性与更低的隐私顾虑,室内雷达感知日益受到关注。然而现有雷达感知流程未能充分考虑多视角雷达设置的独特特性。本文提出雷达目标检测Transformer(RETR),在主流DETR架构基础上进行适配,无需手工设计图像平面的目标检测与分割组件。更重要的是,RETR引入三项关键改进:1)通过可调位置编码实现深度优先特征相似性;2)融合雷达与相机坐标系的三平面损失;3)通过重参数化学习雷达到相机的可变映射。在两个室内雷达感知数据集上的实验表明,该方法在目标检测上相比现有最先进方法提升15.38+ AP,实例分割提升11.91+ IoU。代码已开源于https://github.com/merlresearch/radar-detection-transformer。
原文摘要 · Abstract (English)
Indoor radar perception has seen rising interest due to affordable costs driven by emerging automotive imaging radar developments and the benefits of reduced privacy concerns and reliability under hazardous conditions (e.g., fire and smoke). However, existing radar perception pipelines fail to account for distinctive characteristics of the multi-view radar setting. In this paper, we propose Radar dEtection TRansformer (RETR), an extension of the popular DETR architecture, tailored for multi-view radar perception. RETR inherits the advantages of DETR, eliminating the need for hand-crafted components for object detection and segmentation in the image plane. More importantly, RETR incorporates carefully designed modifications such as 1) depth-prioritized feature similarity via a tunable positional encoding (TPE); 2) a tri-plane loss from both radar and camera coordinates; and 3) a learnable radar-to-camera transformation via reparameterization, to account for the unique multi-view radar setting. Evaluated on two indoor radar perception datasets, our approach outperforms existing state-of-the-art methods by a margin of 15.38+ AP for object detection and 11.91+ IoU for instance segmentation, respectively. Our implementation is available at https://github.com/merlresearch/radar-detection-transformer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。