arXiv:2510.24262cs.CVcs.LG2025-10NeurIPS被引 4

让生成数据更懂任务需求,自动优化训练效果。

UtilGen: Utility-Centric Generative Data Augmentation with Dual-Level Task Adaptation

  • 根据下游任务反馈动态评估生成数据的实用价值。
  • 双层优化提升合成数据质量,平均准确率提高3.87%。
  • 适合需要高质量合成数据的视觉任务研究者。

利用生成模型进行数据增强已成为提升计算机视觉任务性能的强大范式。然而,现有方法主要关注图像保真度和多样性等内在属性,忽视了下游任务的具体需求。不同任务和网络架构对训练数据的要求差异显著,因此生成器需考虑任务特性。为此,我们提出UtilGen,一种以实用性为中心的数据增强框架,通过下游任务反馈自适应优化生成过程,生成更具任务相关性的高价值数据。首先引入权重分配网络评估每张合成样本的任务相关实用性,再基于此采用双层优化策略迭代改进:(1)模型级优化调整生成模型以适配下游任务;(2)实例级优化在每轮生成中调整提示嵌入和初始噪声等生成策略。在八个不同复杂度与粒度的基准数据集上实验表明,UtilGen持续取得更优性能,平均准确率较之前最优方法提升3.87%。进一步的数据影响与分布分析显示,UtilGen生成的数据更具影响力且更贴合任务需求,验证了从视觉特征中心转向任务实用性中心的数据增强范式转变的有效性。

原文摘要 · Abstract (English)

Data augmentation using generative models has emerged as a powerful paradigm for enhancing performance in computer vision tasks. However, most existing augmentation approaches primarily focus on optimizing intrinsic data attributes -- such as fidelity and diversity -- to generate visually high-quality synthetic data, while often neglecting task-specific requirements. Yet, it is essential for data generators to account for the needs of downstream tasks, as training data requirements can vary significantly across different tasks and network architectures. To address these limitations, we propose UtilGen, a novel utility-centric data augmentation framework that adaptively optimizes the data generation process to produce task-specific, high-utility training data via downstream task feedback. Specifically, we first introduce a weight allocation network to evaluate the task-specific utility of each synthetic sample. Guided by these evaluations, UtilGen iteratively refines the data generation process using a dual-level optimization strategy to maximize the synthetic data utility: (1) model-level optimization tailors the generative model to the downstream task, and (2) instance-level optimization adjusts generation policies -- such as prompt embeddings and initial noise -- at each generation round. Extensive experiments on eight benchmark datasets of varying complexity and granularity demonstrate that UtilGen consistently achieves superior performance, with an average accuracy improvement of 3.87% over previous SOTA. Further analysis of data influence and distribution reveals that UtilGen produces more impactful and task-relevant synthetic data, validating the effectiveness of the paradigm shift from visual characteristics-centric to task utility-centric data augmentation.

数据增强生成模型任务适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。