用区域可控生成提升检测数据质量,解决错位与语义泄漏问题。
ReCon: Region-Controllable Data Augmentation with Rectification and Alignment for Object Detection
- 在扩散采样中加入区域反馈修正,精准纠正生成错误区域。
- 引入区域对齐注意力,确保图像与文本提示的空间语义一致。
- 无需复杂调优,适配多种模型和数据规模,效果稳定提升。
数据集的规模与质量对训练鲁棒感知模型至关重要,但大规模标注数据的获取成本高、耗时长。生成模型已成为数据增强的有效工具,可合成符合目标分布的样本。然而,现有生成方法常依赖复杂的后处理或在海量数据上进行微调,且仍易出现内容-位置错配和语义泄漏问题。为此,我们提出ReCon,一种新型增强框架,提升结构可控生成模型在目标检测中的表现。ReCon将区域引导的修正机制融入扩散采样过程,利用预训练感知模型的反馈,在采样阶段修正误生成区域。进一步提出区域对齐交叉注意力,强化图像区域与文本提示之间的空间-语义对齐,从而提升语义一致性与整体图像保真度。大量实验表明,ReCon显著提升生成数据的质量与可训练性,在多种数据集、骨干网络及数据规模下均实现一致性能提升。代码已开源:https://github.com/haoweiz23/ReCon。
原文摘要 · Abstract (English)
The scale and quality of datasets are crucial for training robust perception models. However, obtaining large-scale annotated data is both costly and time-consuming. Generative models have emerged as a powerful tool for data augmentation by synthesizing samples that adhere to desired distributions. However, current generative approaches often rely on complex post-processing or extensive fine-tuning on massive datasets to achieve satisfactory results, and they remain prone to content-position mismatches and semantic leakage. To overcome these limitations, we introduce ReCon, a novel augmentation framework that enhances the capacity of structure-controllable generative models for object detection. ReCon integrates region-guided rectification into the diffusion sampling process, using feedback from a pre-trained perception model to rectify misgenerated regions within diffusion sampling process. We further propose region-aligned cross-attention to enforce spatial-semantic alignment between image regions and their textual cues, thereby improving both semantic consistency and overall image fidelity. Extensive experiments demonstrate that ReCon substantially improve the quality and trainability of generated data, achieving consistent performance gains across various datasets, backbone architectures, and data scales. Our code is available at https://github.com/haoweiz23/ReCon .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。