用元梯度自动选数据,让文生图模型训练更高效
Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selection
- 通过元梯度学习评估每张图像对模型的影响,实现数据智能筛选
- 仅用50%数据训练就超越全量数据,视觉质量显著提升
- 适合追求高效训练的生成模型研究者和工业应用团队
近年来,Imagen、Stable Diffusion 和 FLUX 等文生图模型在视觉质量上取得显著进展,但其性能受限于训练数据质量。网络爬取和合成图像数据集常含低质或冗余样本,导致视觉保真度下降、训练不稳定及计算效率低下。因此,有效的数据筛选至关重要。现有方法依赖昂贵的人工标注或基于单一维度特征的启发式评分,尚未在图像模态中应用元学习。为此,我们提出 Alchemist——首个基于元梯度的自动化、可扩展文生图数据选择框架。该方法从数据中心视角迭代优化模型,通过两阶段流程:数据评分与剪枝。首先训练轻量级评分器,基于梯度信息并结合多粒度感知评估样本影响;随后采用 Shift-Gsampling 策略选取高信息量子集进行高效训练。在合成与网络爬取数据集上的实验表明,Alchemist 持续提升视觉质量和下游性能。使用其筛选出的50%数据训练,效果优于使用完整数据集。
原文摘要 · Abstract (English)
Recent advances in Text-to-Image (T2I) generative models, such as Imagen, Stable Diffusion, and FLUX, have led to remarkable improvements in visual quality. However, their performance is fundamentally limited by the quality of training data. Web-crawled and synthetic image datasets often contain low-quality or redundant samples, which lead to degraded visual fidelity, unstable training, and inefficient computation. Hence, effective data selection is crucial for improving data efficiency. Existing approaches rely on costly manual curation or heuristic scoring based on single-dimensional features in Text-to-Image data filtering. Although meta-learning based method has been explored in LLM, there is no adaptation for image modalities. To this end, we propose **Alchemist**, a meta-gradient-based framework to select a suitable subset from large-scale text-image data pairs. Our approach automatically learns to assess the influence of each sample by iteratively optimizing the model from a data-centric perspective. Alchemist consists of two key stages: data rating and data pruning. We train a lightweight rater to estimate each sample's influence based on gradient information, enhanced with multi-granularity perception. We then use the Shift-Gsampling strategy to select informative subsets for efficient model training. Alchemist is the first automatic, scalable, meta-gradient-based data selection framework for Text-to-Image model training. Experiments on both synthetic and web-crawled datasets demonstrate that Alchemist consistently improves visual quality and downstream performance. Training on an Alchemist-selected 50% of the data can outperform training on the full dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。