用大模型理解概念,让数据蒸馏生成更精准的图像。
CONCORD: Concept-Informed Diffusion for Dataset Distillation
- 用大语言模型提取细粒度概念,指导图像生成过程
- 在ImageNet-1K上达到当前最优性能,小样本下仍保持细节完整
- 无需预训练分类器,提升生成可控性与可解释性
数据蒸馏(DD)在构建能保留大规模原始数据丰富信息的小型数据集方面取得显著进展。基于生成先验的方法表现出色,兼具计算效率和跨架构泛化能力。然而,生成过程对每个样本缺乏显式控制。以往方法主要从整体数据分布匹配角度出发,忽视了实例级别的概念完整性。由于蒸馏设定中样本数量有限,缺失或错误表示的物体细节难以有效弥补。为此,我们提出利用大语言模型(LLMs)的概念理解能力,实现概念引导的扩散(CONCORD)数据蒸馏。具体而言,基于类别标签检索可区分且细粒度的概念,用于指导去噪过程并细化关键物体细节。通过整合这些概念,所提方法显著提升了蒸馏图像生成的可控性与可解释性,且无需依赖预训练分类器。我们在ImageNet-1K及其子集上验证了CONCORD的有效性,达到当前最佳性能。代码已开源:https://github.com/vimar-gu/CONCORD。
原文摘要 · Abstract (English)
Dataset distillation (DD) has witnessed significant progress in creating small datasets that encapsulate rich information from large original ones. Particularly, methods based on generative priors show promising performance, while maintaining computational efficiency and cross-architecture generalization. However, the generation process lacks explicit controllability for each sample. Previous distillation methods primarily match the real distribution from the perspective of the entire dataset, whereas overlooking concept completeness at the instance level. The missing or incorrectly represented object details cannot be efficiently compensated due to the constrained sample amount typical in DD settings. To this end, we propose incorporating the concept understanding of large language models (LLMs) to perform Concept-Informed Diffusion (CONCORD) for dataset distillation. Specifically, distinguishable and fine-grained concepts are retrieved based on category labels to inform the denoising process and refine essential object details. By integrating these concepts, the proposed method significantly enhances both the controllability and interpretability of the distilled image generation, without relying on pre-trained classifiers. We demonstrate the efficacy of CONCORD by achieving state-of-the-art performance on ImageNet-1K and its subsets. The code implementation is released in https://github.com/vimar-gu/CONCORD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。