arXiv:2511.18713cs.CV2025-11AAAI被引 2

用流模型增强自动驾驶数据,让模型更抗干扰。

DriveFlow: Rectified Flow Adaptation for Robust 3D Object Detection in Autonomous Driving

  • 基于频率分解的编辑路径优化,保留物体3D结构。
  • 在多个分布外场景中,所有类别检测性能均提升。
  • 无需训练,适合提升现有模型鲁棒性。

在自动驾驶中,视觉主导的3D目标检测从RGB图像中识别和定位3D物体。然而,由于标注成本高且户外场景多样,训练数据难以覆盖所有测试场景,即存在分布外(OOD)问题。无训练图像编辑通过不修改预训练扩散模型即可增强训练数据,成为提升模型鲁棒性的有前景方案。但基于反演的方法常效果有限且存在固有误差,而近期基于修正流的方法又难以保持物体的精确3D几何。本文提出DriveFlow,一种基于预训练文本到图像流模型的修正流适配方法,用于自动驾驶中的训练数据增强。通过频率分解,引入两种策略:1)高频前景保持:引入高频对齐损失以维持前景物体的精确3D几何;2)双频背景优化:对背景进行双频优化,在编辑灵活性与语义一致性间取得平衡。全面实验验证了DriveFlow的有效性与高效性,在所有类别及分布外场景下均实现性能提升。代码已开源:https://github.com/Hongbin98/DriveFlow。

原文摘要 · Abstract (English)

In autonomous driving, vision-centric 3D object detection recognizes and localizes 3D objects from RGB images. However, due to high annotation costs and diverse outdoor scenes, training data often fails to cover all possible test scenarios, known as the out-of-distribution (OOD) issue. Training-free image editing offers a promising solution for improving model robustness by training data enhancement without any modifications to pre-trained diffusion models. Nevertheless, inversion-based methods often suffer from limited effectiveness and inherent inaccuracies, while recent rectified-flow-based approaches struggle to preserve objects with accurate 3D geometry. In this paper, we propose DriveFlow, a Rectified Flow Adaptation method for training data enhancement in autonomous driving based on pre-trained Text-to-Image flow models. Based on frequency decomposition, DriveFlow introduces two strategies to adapt noise-free editing paths derived from text-conditioned velocities. 1) High-Frequency Foreground Preservation: DriveFlow incorporates a high-frequency alignment loss for foreground to maintain precise 3D object geometry. 2) Dual-Frequency Background Optimization: DriveFlow also conducts dual-frequency optimization for background, balancing editing flexibility and semantic consistency. Comprehensive experiments validate the effectiveness and efficiency of DriveFlow, demonstrating comprehensive performance improvements on all categories across OOD scenarios. Code is available at https://github.com/Hongbin98/DriveFlow.

3D检测扩散模型自动驾驶数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。