arXiv:2505.20967cs.CV2025-05被引 5

用雷达数据实现动态户外场景的逼真视角合成

RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes

  • 基于毫米波雷达构建时空神经场,显式建模物体运动
  • 在动态户外场景中,雷达重建精度显著优于现有方法
  • 适合自动驾驶等恶劣环境下的视觉重建任务

神经场(NFs)在场景重建与新视角合成方面取得了显著进展。然而,依赖RGB或激光雷达输入的现有方法在恶劣天气下表现不佳,限制了其在自动驾驶等真实户外环境中的鲁棒性。相比之下,毫米波雷达对环境变化具有天然抗性,但其与神经场的结合仍处于探索阶段。此外,户外驾驶场景常包含动态物体,因此时空建模对保持时序一致性至关重要。为此,我们提出RF4D——一种面向户外动态场景的新视角合成雷达基神经场框架。该方法将时间信息显式融入表示,更准确地建模物体运动;通过专用场景流模块预测相邻帧间的时序偏移,确保动态场景重建中的时空占据一致性。同时,我们提出基于雷达感知物理的功率渲染公式,提升了合成精度与可解释性。在公开雷达数据集上的大量实验表明,RF4D在雷达测量合成和占据估计精度上均显著优于现有方法,尤其在动态户外环境中表现突出。

原文摘要 · Abstract (English)

Neural fields (NFs) have achieved remarkable success in scene reconstruction and novel view synthesis. However, existing NF approaches that rely on RGB or LiDAR inputs often struggle under adverse weather conditions, limiting their robustness in real-world outdoor environments such as autonomous driving. In contrast, millimeter-wave radar is inherently resilient to environmental variations, yet its integration with NFs remains largely underexplored. Moreover, outdoor driving scenes frequently involve dynamic objects, making spatiotemporal modeling crucial for temporally consistent novel view synthesis. To address these challenges, we present RF4D, a radar-based neural field framework tailored for novel view synthesis in outdoor dynamic scenes. RF4D explicitly incorporates temporal information into its representation, enabling more accurate modeling of object motion. A dedicated scene flow module further predicts temporal offsets between adjacent frames, enforcing temporal occupancy coherence during dynamic scene reconstruction. Moreover, we propose a radar-specific power rendering formulation grounded in radar sensing physics, improving both synthesis accuracy and interpretability. Extensive experiments on public radar datasets demonstrate that RF4D substantially outperforms existing methods in radar measurement synthesis and occupancy estimation accuracy, with particularly strong gains in dynamic outdoor environments.

神经场雷达感知动态场景自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。