用雷达信号重建3D形状,支持部分视角下任意物体还原。
Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions
- 通过多分辨率符号距离函数建模,将雷达频谱映射到形状特征空间。
- 在有限视角下仍可重建任意3D形状,对仿真与实测数据均有效。
- 提出新基准数据集,推动雷达三维重建技术落地应用。
从高频雷达信号中重构3D物体形状在商业和航空航天领域至关重要,但解析复杂。现有深度学习方法难以表征任意形状,且对有限视角下的真实雷达信号处理不佳;光学3D重建虽能应对有限视角,但直接将雷达信号视为相机视图效果差。本文提出Radar2Shape,一种去噪扩散模型,通过关联雷达信号频率与多分辨率形状特征,实现部分可观测雷达信号下的3D重建。该方法分两阶段:首先学习具有层级分辨率的正则化潜在空间,其次以粗到精方式条件扩散至该空间。实验表明,Radar2Shape可在部分观测条件下成功还原任意3D形状,并在两种不同仿真方法及真实数据上展现鲁棒泛化能力。此外,我们发布了两个合成基准数据集,助力未来高频雷达领域研究,使Radar2Shape等模型可安全应用于实际雷达系统。
原文摘要 · Abstract (English)
Determining the shape of 3D objects from high-frequency radar signals is analytically complex but critical for commercial and aerospace applications. Previous deep learning methods have been applied to radar modeling; however, they often fail to represent arbitrary shapes or have difficulty with real-world radar signals which are collected over limited viewing angles. Existing methods in optical 3D reconstruction can generate arbitrary shapes from limited camera views, but struggle when they naively treat the radar signal as a camera view. In this work, we present Radar2Shape, a denoising diffusion model that handles a partially observable radar signal for 3D reconstruction by correlating its frequencies with multiresolution shape features. Our method consists of a two-stage approach: first, Radar2Shape learns a regularized latent space with hierarchical resolutions of shape features, and second, it diffuses into this latent space by conditioning on the frequencies of the radar signal in an analogous coarse-to-fine manner. We demonstrate that Radar2Shape can successfully reconstruct arbitrary 3D shapes even from partially-observed radar signals, and we show robust generalization to two different simulation methods and real-world data. Additionally, we release two synthetic benchmark datasets to encourage future research in the high-frequency radar domain so that models like Radar2Shape can safely be adapted into real-world radar systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。