arXiv:2509.12482cs.CV2025-09ICCV被引 10

用100万样本训练出可通用的雷达基础模型,让低成本芯片雷达达到高分辨率效果。

Towards Foundational Models for Single-Chip Radar

  • 基于原始雷达数据训练4D雷达基础模型,不依赖损失性特征表示
  • 在仅29小时数据下实现接近高分辨率传感器的3D占用与语义分割精度
  • 模型可跨场景迁移,且数据量每增10倍性能提升20%,适合自动驾驶和室内感知

毫米波雷达体积小、成本低、耐环境,对遮挡和光照变化鲁棒,但廉价单芯片雷达角度分辨率差。尽管已有不少学习方法缓解此问题,但缺乏标准化的基础模型与大规模数据集,多数研究仍从零开始训练小规模任务模型。本文收集了迄今最大的原始雷达数据集,含100万样本(29小时),并训练出面向4D单芯片雷达的基础模型——通用雷达变换器(GRT)。该模型能以近似高分辨率传感器的精度预测3D占据和语义分割。实验表明,GRT具有强泛化能力,支持任务微调,并呈现每10倍数据量性能提升20%的对数缩放特性。大量消融实验显示,使用原始雷达数据显著优于常用有损表示,等效于数据量增加10倍。最后估算,约需1亿样本(3000小时)数据才能充分发挥GRT潜力。

原文摘要 · Abstract (English)

mmWave radars are compact, inexpensive, and durable sensors that are robust to occlusions and work regardless of environmental conditions, such as weather and darkness. However, this comes at the cost of poor angular resolution, especially for inexpensive single-chip radars, which are typically used in automotive and indoor sensing applications. Although many have proposed learning-based methods to mitigate this weakness, no standardized foundational models or large datasets for the mmWave radar have emerged, and practitioners have largely trained task-specific models from scratch using relatively small datasets. In this paper, we collect (to our knowledge) the largest available raw radar dataset with 1M samples (29 hours) and train a foundational model for 4D single-chip radar, which can predict 3D occupancy and semantic segmentation with quality that is typically only possible with much higher resolution sensors. We demonstrate that our Generalizable Radar Transformer (GRT) generalizes across diverse settings, can be fine-tuned for different tasks, and shows logarithmic data scaling of 20\% per $10\times$ data. We also run extensive ablations on common design decisions, and find that using raw radar data significantly outperforms widely-used lossy representations, equivalent to a $10\times$ increase in training data. Finally, we roughly estimate that $\approx$100M samples (3000 hours) of data are required to fully exploit the potential of GRT.

雷达感知基础模型4D雷达数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。