用4D雷达辅助自监督重建动态驾驶场景,提升运动物体精度。
4DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar
- 结合4D雷达速度与空间信息初始化高斯点,精准分割动态物体。
- 提出速度引导的点追踪模型,实现时序一致的动态轨迹重建。
- 适合自动驾驶感知训练与系统验证,对动态场景建模有显著提升。
3D重建与新视角合成对自动驾驶系统验证和感知模型训练至关重要。现有自监督方法虽具成本低、泛化性强等优势,但在缺乏标注框的场景中,依赖频域解耦或光流的方法因运动估计不准、时序不一致,难以准确重建动态物体,导致动态元素呈现不完整或失真。为此,我们提出4DRadar-GS,一种面向动态驾驶场景的4D雷达增强型自监督3D重建框架。首先设计4D雷达辅助的高斯初始化方案,利用雷达的速度与空间信息分割动态物体并恢复单目深度尺度,生成精确的高斯点表示。同时提出速度引导点追踪(VGPT)模型,在场景流监督下与重建流程联合训练,实现细粒度动态轨迹追踪与时序一致性表征。在OmniHD-Scenes数据集上评估,4DRadar-GS在动态驾驶场景3D重建中达到当前最优性能。
原文摘要 · Abstract (English)
3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and enhanced generalization in scenarios where annotated bounding boxes are unavailable. However, existing approaches, which often rely on frequency-domain decoupling or optical flow, struggle to accurately reconstruct dynamic objects due to imprecise motion estimation and weak temporal consistency, resulting in incomplete or distorted representations of dynamic scene elements. To address these challenges, we propose 4DRadar-GS, a 4D Radar-augmented self-supervised 3D reconstruction framework tailored for dynamic driving scenes. Specifically, we first present a 4D Radar-assisted Gaussian initialization scheme that leverages 4D Radar's velocity and spatial information to segment dynamic objects and recover monocular depth scale, generating accurate Gaussian point representations. In addition, we propose a Velocity-guided PointTrack (VGPT) model, which is jointly trained with the reconstruction pipeline under scene flow supervision, to track fine-grained dynamic trajectories and construct temporally consistent representations. Evaluated on the OmniHD-Scenes dataset, 4DRadar-GS achieves state-of-the-art performance in dynamic driving scene 3D reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。