arXiv:2410.13453cs.CV2024-10被引 2

用大模型动态优化图像增强策略,提升模型性能且节省计算资源。

Adaptive Augmentation Policy Optimization with LLM Feedback

  • 大模型根据数据特征和模型表现动态选择增强方式
  • 相比传统方法,准确率提升且无需重复训练
  • 特别适合医疗影像等专业领域,可自适应调整

数据增强是深度学习流程中的关键环节,通过增加数据多样性来提升模型泛化能力。传统增强策略依赖人工设计、随机采样或基于搜索的自动化方法。尽管自动化方法提升性能,但常需大量计算资源,且针对特定数据集定制。本文提出一种由大语言模型(LLM)引导的增强策略优化方法,基于模型表现反馈迭代优化增强策略。提出两种方案:(1) LLM引导的增强策略优化,在训练周期中迭代优化;(2) 自适应的LLM引导增强策略优化,每轮根据性能指标动态调整。该训练中方法无需完整重训即可获取LLM反馈,降低计算成本并提升性能。方法利用LLM的上下文知识,根据数据特征、模型架构及历史训练表现动态选择增强变换,尤其在医学影像等专业任务中表现优异。跨多个特定领域图像分类数据集的实验显示,本方法持续优于传统方法。

原文摘要 · Abstract (English)

Data augmentation is a critical component of deep learning pipelines, enhancing model generalization by increasing dataset diversity. Traditional augmentation strategies rely on manually designed transformations, stochastic sampling, or automated search-based approaches. Although automated methods improve performance, they often require extensive computational resources and are specifically designed for certain datasets. In this work, we propose a Large Language Model (LLM)-guided augmentation optimization strategy that refines augmentation policies based on model performance feedback. We propose two approaches: (1) LLM-Guided Augmentation Policy Optimization, where augmentation policies selected by LLM are refined iteratively across training cycles, and (2) Adaptive LLM-Guided Augmentation Policy Optimization, which adjusts policies at each iteration based on performance metrics. This in-training approach eliminates the need for full model retraining before getting LLM feedback, reducing computational costs while increasing performance. Our methodology employs an LLM to dynamically select augmentation transformations based on dataset characteristics, model architecture, and prior training performance. Leveraging LLMs' contextual knowledge, especially in domain-specific tasks like medical imaging, our method selects augmentations tailored to dataset characteristics and model performance. Experiments across domain-specific image classification datasets show consistent accuracy improvements over traditional methods.

数据增强大模型自适应优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。