arXiv:2605.18012cs.CVcs.AI2026-05

用语义信息优化生成数据集蒸馏,让小数据集更精准、多样。

SAS: Semantic-aware Sampling for Generative Dataset Distillation

论文配图:SAS: Semantic-aware Sampling for Generative Dataset Distillation
图 1 · 摘自论文原文
  • 利用CLIP模型评估图像语义,设计三类评分函数。
  • 两阶段采样:先筛选语义判别样本,再动态选多样性样本。
  • 在多个数据集和模型上提升性能,适合追求高效训练的研究者。

深度神经网络在众多任务中表现卓越,但其成功常伴随大规模训练数据带来的巨大计算与存储开销。数据集蒸馏通过构建紧凑且信息丰富的数据集,实现高效模型训练并保持下游性能。然而,现有方法多关注数据分布或下游训练统计的匹配,较少关注保留蒸馏数据的高层语义信息。本文提出一种语义感知的数据集蒸馏方法,利用对比语言-图像预训练(CLIP)作为后采样阶段的语义先验。目标是获得既紧凑又具有类别判别性与多样性的蒸馏数据集。为此,设计三种语义评分函数,量化预训练语义空间中的类别相关性、类间可分性及组内多样性。基于现有蒸馏方法生成的图像池,提出两阶段采样策略:第一阶段筛选语义判别样本形成可靠候选集;第二阶段进行动态多样性感知选择,减少冗余同时保持语义覆盖。在多个数据集、图像池和下游模型上的大量实验表明,该方法持续提升性能,验证了引入语义信息的有效性。

原文摘要 · Abstract (English)

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this challenge by constructing compact yet informative datasets that enable efficient model training while maintaining downstream performance. However, most existing approaches primarily emphasize matching data distributions or downstream training statistics, with limited attention to preserving high-level semantic information in the distilled data. In this work, we introduce a semantic-aware perspective for dataset distillation by leveraging Contrastive Language-Image Pretraining (CLIP) as a semantic prior for post-sampling. Our goal is to obtain distilled datasets that are not only compact but also semantically class-discriminative and diverse. To this end, we design three semantic scoring functions that quantify class relevance, inter-class separability, and intra-set diversity in a pretrained semantic space. Based on image pools generated by existing distillation methods, we further develop a two-stage strategy for effective sampling: the first stage filters semantically discriminative samples to form a reliable candidate set, and the second stage performs a dynamic diversity-aware selection to reduce redundancy while preserving semantic coverage. Extensive experiments across multiple datasets, image pools, and downstream models demonstrate consistent performance gains, highlighting the effectiveness of incorporating semantic information into dataset distillation.

数据集蒸馏语义感知CLIP高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。