arXiv:2412.05466cs.LGcs.CV2024-12被引 1

用强化学习动态筛选高质量合成数据,提升模型准确率最多10%。

Multi-Armed Bandit Approach for Optimizing Training on Synthetic Data

  • 基于UCB算法动态选择合成数据,随训练过程自适应调整
  • 新指标融合图像多层信息,可有效排名合成数据可用性
  • 结合大模型与Stable Diffusion生成更优合成数据,适合数据稀缺场景

监督学习需大规模训练数据,合成数据近年发展迅速,但其可用性评估仍待解决。本文提出一种基于UCB的训练流程,结合动态可用性度量,整合合成图像的低层与高层特征,超越传统指标。该方法能持续优化模型学习,自适应模型状态变化,动态评估训练样本价值。实验表明,所提度量可有效排序合成图像可用性;进一步提出属性感知的带式生成流水线,融合大语言模型与Stable Diffusion生成合成数据。定量结果表明,本方法显著提升多种分类器性能,相比传统方法最高提升10%分类准确率。代码、数据集及附加材料已公开于https://github.com/A-Kerim/Synthetic-Data-Usability-2024。

原文摘要 · Abstract (English)

Supervised machine learning methods require large-scale training datasets to perform well in practice. Synthetic data has been showing great progress recently and has been used as a complement to real data. However, there is yet a great urge to assess the usability of synthetically generated data. To this end, we propose a novel UCB-based training procedure combined with a dynamic usability metric. Our proposed metric integrates low-level and high-level information from synthetic images and their corresponding real and synthetic datasets, surpassing existing traditional metrics. By utilizing a UCB-based dynamic approach ensures continual enhancement of model learning. Unlike other approaches, our method effectively adapts to changes in the machine learning model's state and considers the evolving utility of training samples during the training process. We show that our metric is an effective way to rank synthetic images based on their usability. Furthermore, we propose a new attribute-aware bandit pipeline for generating synthetic data by integrating a Large Language Model with Stable Diffusion. Quantitative results show that our approach can boost the performance of a wide range of supervised classifiers. Notably, we observed an improvement of up to 10% in classification accuracy compared to traditional approaches, demonstrating the effectiveness of our approach. Our source code, datasets, and additional materials are publically available at https://github.com/A-Kerim/Synthetic-Data-Usability-2024.

合成数据强化学习图像生成模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。