arXiv:2605.18507cs.CV2026-05中稿 · ICML

仅用图像和里程计实现4D雷达场景流弱监督学习,性能超越依赖激光雷达的方法。

Weakly Supervised Cross-Modal Learning for 4D Radar Scene Flow Estimation

论文配图:Weakly Supervised Cross-Modal Learning for 4D Radar Scene Flow Estimation
图 1 · 摘自论文原文
  • 利用2D追踪与分割生成实例级语义引导,结合里程计构建刚性静态区域约束。
  • 在VoD数据集上达到领先性能,优于依赖激光雷达的跨模态监督方法。
  • 无需昂贵激光雷达,适合低成本自动驾驶感知系统部署。

由于4D雷达场景流标注数据难以获取,现有方法通常依赖自监督损失或使用3D激光雷达、2D图像及里程计进行跨模态监督。然而,自监督方法因雷达测量精度低而效果不佳,现有跨模态监督方法则需复杂多任务架构并依赖昂贵激光雷达生成伪标签。为此,本文提出一种面向任务的迭代式弱监督框架,仅使用图像与里程计作为辅助监督。具体地,通过现成2D追踪与分割算法获取追踪实例掩码,并反投影至3D空间以提供实例级语义引导;对静态区域,融合车辆里程计与雷达固有运动线索构建刚性静态损失。在真实世界数据集View-of-Delft(VoD)上的大量实验表明,该方法不仅超越依赖密集激光点云3D多目标追踪的先进跨模态监督方法,还优于现有全监督场景流估计方法。代码已开源:https://github.com/FuJingyun/IterFlow。

原文摘要 · Abstract (English)

Due to the difficulty of obtaining ground-truth data for 4D radar scene flow estimation, previous methods typically rely on either self-supervised losses or cross-modal supervision using 3D LiDAR data, 2D images, and odometry. However, self-supervised approaches often yield suboptimal results due to radar's inherently low-fidelity measurements, while existing cross-modal supervised methods introduce complex multi-task architecture and require costly LiDAR sensors to generate pseudo radar scene flow labels from pretrained 3D tracking models. To overcome these limitations, we propose a task-specific iterative framework for weakly supervised radar scene flow learning, using only images and odometry for auxiliary supervision during training. Specially, we establish two novel instance-aware self-supervised losses by exploiting off-the-shelf 2D tracking and segmentation algorithms to obtain tracked instance masks, which are back-projected into 3D space to provide instance-level semantic guidance; for static regions, we integrate vehicle odometry with radar's intrinsic motion cues to construct a rigid static loss. Extensive experiments on the real-world View-of-Delft (VoD) dataset demonstrate that our method not only surpasses state-of-the-art cross-modal supervised approaches that rely on 3D multi-object tracking on dense LiDAR point clouds but also outperforms existing fully supervised scene flow estimation methods. The code is open-sourced at \href{https://github.com/FuJingyun/IterFlow}{https://github.com/FuJingyun/IterFlow}.

4D雷达弱监督跨模态场景流

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。