可控雷达仿真框架,让虚拟雷达数据逼近真实表现。
Controllable Radar Simulation with Waveform Parameter Embedding
- 用波形参数嵌入抽象雷达物理,实现属性可调
- 融合真实、模拟与解析数据训练,覆盖广泛雷达特征
- 支持视角变化和属性编辑,适合自动驾驶研发
自动驾驶仿真器仍缺乏高保真雷达,而雷达在恶劣天气下对感知至关重要。现有雷达立方体仿真方法或依赖神经生成器(不透明且难控),或依赖电磁仿真管道(慢且需专有硬件),均难以捕捉真实复杂性。本文提出Ctrl-RS,结合两者优势:首先,从多元传感器(包括LiDAR、单目相机和已有雷达)构建环境反射张量;其次,将雷达物理抽象为一组紧凑的波形参数,表征三维点扩散函数,实现对距离分辨率、多普勒展宽、方位波束形状等属性的直观嵌入;第三,在大规模混合数据集(含真实、解析合成与仿真生成雷达立方体)上训练WARP-Net,覆盖广泛雷达属性分布。该框架支持视角变换、目标移除与属性编辑。在RADDet、Carrada和nuScenes上的实验表明,其仿真数据在2D检测与语义分割上可媲美甚至超越真实雷达,与真实数据结合后持续提升3D检测性能。项目开源地址:https://github.com/zhuxing0/Ctrl-RS。
原文摘要 · Abstract (English)
Autonomous driving simulators still lack high-fidelity radar, even though radar is critical for robust perception in adverse weather. A key obstacle is that raw radar point clouds are extremely sparse and stochastic, making it difficult to model; we argue that simulating the full range-azimuth-Doppler cube is a more principled target. Existing radar cube simulators either rely purely on neural generators, which are opaque and offer little control over sensor attributes, or on detailed electromagnetic pipelines, which are slow, require proprietary hardware specifications, and still struggle to capture real-world complexity. We introduce Ctrl-RS, a controllable radar cube simulation framework that combines the strengths of both worlds. First, we build an environment reflection tensor from diverse sensor sources (including LiDAR, monocular cameras, and existing radar). Second, we abstract radar physics into a compact set of waveform parameters that characterize the 3D point spread function, yielding an intuitive embedding of radar attributes such as range resolution, Doppler broadening, and azimuth beam shape. Third, we train a WARP-Net on a large mixed dataset that fuses real, analytically synthesized, and simulator-generated radar cubes to cover a wide distribution of radar attributes. Ctrl-RS supports viewpoint changes, actor removal, and attribute editing. Experiments on RADDet, Carrada, and nuScenes show that our simulated data can match or surpass real radar in 2D detection and semantic segmentation, and consistently boosts performance in 3D detection when combined with real data. The Project is available at https://github.com/zhuxing0/Ctrl-RS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。