arXiv:2508.01139cs.CVcs.AI2025-08中稿 · TMLR被引 6

通过补偿色彩提升压缩数据集质量,实现更优的模型性能与泛化。

Dataset Condensation with Color Compensation

  • 基于潜空间扩散模型增强图像色彩多样性,避免语义扭曲。
  • 在多个基准上超越现有方法,最高提升4.2%准确率。
  • 首个用压缩数据微调预训练扩散模型的研究,适合数据高效场景。

数据集压缩面临性能与保真度之间的根本权衡。现有方法存在两大瓶颈:基于图像的选择方法(如Coreset Selection、Dataset Quantization)效率低下,而基于像素的优化方法(如Dataset Distillation)因过度参数化导致语义失真。我们观察到,色彩在数据压缩中兼具信息载体与语义单元双重角色,被普遍忽视。为此,我们提出DC3:一种带色彩补偿的数据集压缩框架。经校准选择后,DC3利用潜空间扩散模型增强图像色彩多样性,而非生成全新图像。大量实验表明,DC3在多个基准上均优于当前最优方法,且在不同数据集和模型上具备强泛化能力。据我们所知,除了关注下游任务外,DC3是首个使用压缩数据微调预训练扩散模型的研究。FID与IS结果证明,用高质量压缩数据训练网络可避免模型坍塌等退化问题。代码与生成数据见https://github.com/528why/Dataset-Condensation-with-Color-Compensation。

原文摘要 · Abstract (English)

Dataset condensation always faces a constitutive trade-off: balancing performance and fidelity under extreme compression. Existing methods struggle with two bottlenecks: image-level selection methods (Coreset Selection, Dataset Quantization) suffer from inefficiency condensation, while pixel-level optimization (Dataset Distillation) introduces semantic distortion due to over-parameterization. With empirical observations, we find that a critical problem in dataset condensation is the oversight of color's dual role as an information carrier and a basic semantic representation unit. We argue that improving the colorfulness of condensed images is beneficial for representation learning. Motivated by this, we propose DC3: a Dataset Condensation framework with Color Compensation. After a calibrated selection strategy, DC3 utilizes the latent diffusion model to enhance the color diversity of an image rather than creating a brand-new one. Extensive experiments demonstrate the superior performance and generalization of DC3 that outperforms SOTA methods across multiple benchmarks. To the best of our knowledge, besides focusing on downstream tasks, DC3 is the first research to fine-tune pre-trained diffusion models with condensed datasets. The Frechet Inception Distance (FID) and Inception Score (IS) results prove that training networks with our high-quality datasets is feasible without model collapse or other degradation issues. Code and generated data are available at https://github.com/528why/Dataset-Condensation-with-Color-Compensation.

数据压缩扩散模型色彩补偿高效学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。