arXiv:2507.13074cs.CV2025-07

用检测器引导生成更准确的合成数据,提升压缩数据集质量。

Label-Consistent Dataset Distillation with Detector-Guided Refinement

  • 用预训练检测器识别标签错误或质量差的合成图像
  • 通过对比检测置信度和样本差异,选出最优候选图像
  • 适合需要高质量小规模数据集的研究者使用

数据集蒸馏旨在生成紧凑且信息丰富的替代数据集,以降低存储与计算开销。尽管扩散模型在该领域取得进展,生成的合成数据常存在标签不一致或结构细节不足问题,影响下游性能。为此,本文提出一种检测器引导的数据集蒸馏框架,利用预训练检测器识别并修正异常合成样本,确保标签一致性与图像质量。具体地,基于原数据集训练的检测器用于发现标签不符或分类置信度低的图像;对每个缺陷样本,使用预训练扩散模型生成多个候选图像,条件为对应图像原型与标签;最优候选通过联合考虑检测器置信度与与已有合格样本的差异性选择,兼顾标签准确性与类内多样性。实验表明,本方法可生成细节更丰富、质量更高的代表性图像,在验证集上达到当前最佳性能。

原文摘要 · Abstract (English)

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made significant progress in dataset distillation, the generated surrogate datasets often contain samples with label inconsistencies or insufficient structural detail, leading to suboptimal downstream performance. To address these issues, we propose a detector-guided dataset distillation framework that explicitly leverages a pre-trained detector to identify and refine anomalous synthetic samples, thereby ensuring label consistency and improving image quality. Specifically, a detector model trained on the original dataset is employed to identify anomalous images exhibiting label mismatches or low classification confidence. For each defective image, multiple candidates are generated using a pre-trained diffusion model conditioned on the corresponding image prototype and label. The optimal candidate is then selected by jointly considering the detector's confidence score and dissimilarity to existing qualified synthetic samples, thereby ensuring both label accuracy and intra-class diversity. Experimental results demonstrate that our method can synthesize high-quality representative images with richer details, achieving state-of-the-art performance on the validation set.

数据集蒸馏扩散模型检测器引导图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。