arXiv:2609.02289cs.CV2026-09

用雷达检测移动物体,不依赖分类,还能识别罕见目标。

If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection

论文配图:If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection
图 1 · 摘自论文原文
  • 基于雷达回波聚类生成动态查询,适应稀疏场景
  • 仅用110万参数达88.3%检测精度,速度误差仅0.81米/秒
  • 适合夜间、雨天及遮挡环境,对未标注目标仍有效

基于封闭集标注的检测器会漏掉训练类别外的稀有移动目标。汽车雷达提供与类别无关的多普勒运动信息,受光照和天气影响小,但回波稀疏且噪声大,难以实现类别感知的3D框检测。当完整几何结构难以恢复时,表面位置和速度仍可用于运动推理与避撞。本文提出物理感知雷达变压器(PART),一种全稀疏雷达独占检测器,可预测每个移动目标假设的存在置信度、代表性表面点及2D地面平面速度。多普勒感知查询初始化(DAQI)通过在位置和速度空间聚类雷达回波,以输入相关提案替代场景无关的预设查询,缓解稀疏场景下的查询-对象分配问题。物理引导交叉注意力(PGCA)融合径向-多普勒一致性与雷达截面积(RCS)信息,增强查询-点关联。不确定性感知监督随机掩码真实目标,为模糊雷达支持的查询赋予软存在目标,降低对详尽标注的依赖。仅含110万参数的PART在nuScenes数据集上达到0.8827的类别无关平均精度(CA-AP),均方表面位移误差(mASTE)为0.3188米,均方速度误差(mAVE)为0.8084米/秒。其对标准评估中排除的稀有且安全相关的类别召回率达0.9203,在夜间、雨天及严重遮挡下依然有效。对假阳性样本的检查显示,部分预测对应nuScenes标注中缺失的移动目标。代码与预训练模型权重将公开于https://github.com/sunyinghao-uestc/PART。

原文摘要 · Abstract (English)

Detectors trained on closed-set annotations can miss rare moving objects outside the training taxonomy. Automotive radar provides category-independent Doppler motion cues and is less affected by adverse illumination and weather, but sparse, noisy returns hinder class-aware 3D box detection. Surface location and velocity remain useful for motion reasoning and collision avoidance when full box geometry is difficult to recover. We present the Physics-Aware Radar Transformer (PART), a fully sparse radar-only detector that predicts existence confidence, a representative surface point, and 2D ground-plane velocity for each moving-object hypothesis. Doppler-Aware Query Initialization (DAQI) replaces scene-independent learned queries with input-dependent proposals by clustering radar returns in position and velocity, easing query-object assignment in sparse scenes. Physics-Guided Cross-Attention (PGCA) incorporates radial-Doppler consistency and radar cross section (RCS) into query-point association. Uncertainty-aware supervision randomly masks ground-truth objects and assigns soft existence targets to ambiguous radar-supported queries, reducing reliance on exhaustive annotations. With only 1.1 million parameters, PART achieves a class-agnostic average precision (CA-AP) of 0.8827, a mean average surface translation error (mASTE) of 0.3188 m, and a mean average velocity error (mAVE) of 0.8084 m/s on nuScenes. It attains 0.9203 recall on rare and safety-relevant categories excluded from the standard evaluation and remains effective at night, in rain, and under severe occlusion. Inspection of apparent false positives shows that some predictions correspond to moving objects absent from the nuScenes annotations. Code and pretrained model weights will be publicly available at https://github.com/sunyinghao-uestc/PART.

雷达检测稀疏感知物理先验自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。