arXiv:2409.20164cs.CV2024-09被引 1

用扩散模型擦除并重绘图像,提升道路检测数据多样性。

Erase, then Redraw: A Novel Data Augmentation Approach for Free Space Detection Using Diffusion Model

  • 用预训练扩散模型擦除真实物体并生成语义相似新物体。
  • 在KITTI数据集上优于其他增强方法,显著提升检测性能。
  • 适合需要高质量数据增强的道路感知与自动驾驶研究者。

数据增强是深度学习中的常用技术,支撑了分类、检测和语义分割等任务的进展。传统方法仅使用旋转、翻转等简单变换,难以在语义层面增加多样性,无法改变场景中车辆、树木、建筑等高阶语义属性。近年来,生成模型的发展为数据增强带来新可能。本文提出一种基于预训练文本到图像扩散模型的新方法,通过参数化图像到图像的转换,实现对真实场景的语义编辑:先擦除原图中物体,再在空缺区域用扩散模型生成语义一致的新实例,从而扩充数据集。该方法在KITTI道路检测数据集上表现最优,验证了其有效性。

原文摘要 · Abstract (English)

Data augmentation is one of the most common tools in deep learning, underpinning many recent advances including tasks such as classification, detection, and semantic segmentation. The standard approach to data augmentation involves simple transformations like rotation and flipping to generate new images. However, these new images often lack diversity along the main semantic dimensions within the data. Traditional data augmentation methods cannot alter high-level semantic attributes such as the presence of vehicles, trees, and buildings in a scene to enhance data diversity. In recent years, the rapid development of generative models has injected new vitality into the field of data augmentation. In this paper, we address the lack of diversity in data augmentation for road detection task by using a pre-trained text-to-image diffusion model to parameterize image-to-image transformations. Our method involves editing images using these diffusion models to change their semantics. In essence, we achieve this goal by erasing instances of real objects from the original dataset and generating new instances with similar semantics in the erased regions using the diffusion model, thereby expanding the original dataset. We evaluate our approach on the KITTI road dataset and achieve the best results compared to other data augmentation methods, which demonstrates the effectiveness of our proposed development.

数据增强扩散模型道路检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。