用带谱信息的稀疏点云替代密集谱图,提升雷达感知鲁棒性。
Revisiting Radar Perception With Spectral Point Clouds
- 将点云视为雷达谱的稀疏压缩表示,注入谱信息增强表达
- 在特定密度下,点云模型性能可媲美甚至超过密集谱基准
- 适合构建跨传感器统一输入,为雷达大模型奠基
雷达感知模型采用不同输入形式,从距离-多普勒谱到稀疏点云。传统认为密集谱优于稀疏点云,但其表现受传感器和配置影响大,难以迁移。本文提出谱点云范式,将点云视为雷达谱的稀疏压缩表示,并通过注入谱信息提升其表达能力。我们建立实验框架,对比不同密度的谱点云(PC)模型与密集距离-多普勒(RD)基准。结果表明,在特定密度下,PC模型可达到甚至超越RD基准性能。此外,两种基础的谱增强方法进一步提升了点云表现。研究证明,谱点云在保持鲁棒性的同时,具备与密集谱相当甚至更优的潜力,是实现统一雷达感知输入的理想候选,为未来雷达基础模型铺平道路。
原文摘要 · Abstract (English)
Radar perception models are trained with different inputs, from range-Doppler spectra to sparse point clouds. Dense spectra are assumed to outperform sparse point clouds, yet they can vary considerably across sensors and configurations, which hinders transfer. In this paper, we provide alternatives for incorporating spectral information into radar point clouds and show that, point clouds need not underperform compared to spectra. We introduce the spectral point cloud paradigm, where point clouds are treated as sparse, compressed representations of the radar spectra, and argue that, when enriched with spectral information, they serve as strong candidates for a unified input representation that is more robust against sensor-specific differences. We develop an experimental framework that compares spectral point cloud (PC) models at varying densities against a dense range-Doppler (RD) benchmark, and report the density levels where the PC configurations meet the performance of the RD benchmark. Furthermore, we experiment with two basic spectral enrichment approaches, that inject additional target-relevant information into the point clouds. Contrary to the common belief that the dense RD approach is superior, we show that point clouds can do just as well, and can surpass the RD benchmark when enrichment is applied. Spectral point clouds can therefore serve as strong candidates for unified radar perception, paving the way for future radar foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。