arXiv:2506.23580cs.CV2025-06ICCV被引 18

用图文原型联合压缩数据集,提升模型泛化能力。

Dataset Distillation via Vision-Language Category Prototype

  • 引入文本原型与图像原型协同生成压缩数据。
  • 在无预设文本描述的数据集上仍达顶尖性能。
  • 适合需要强泛化能力的复杂视觉任务研究者。

数据集蒸馏(DD)将大规模数据集浓缩为小型但信息丰富的替代品,在保持原始数据集性能的同时降低存储、传输成本和计算开销。然而,以往方法主要关注图像信息,忽视了数据中固有的语义信息。忽略上下文会限制模型在复杂数据集上的泛化能力,可能导致逻辑错误或关键对象遗漏。本研究将视觉语言方法引入DD,通过引入由开源大语言模型生成的描述性文本信息构建文本原型,并与图像原型协同合成数据,从而提升蒸馏性能。该框架无需预设文本描述即可广泛应用,突破传统仅依赖图像的方法局限。相比现有方法,新方案生成的图像逻辑连贯且包含目标物体,在验证集上达到领先表现,展现出优异泛化能力。源代码与生成数据已公开于 https://github.com/zou-yawen/Dataset-Distillation-via-Vision-Language-Category-Prototype/

原文摘要 · Abstract (English)

Dataset distillation (DD) condenses large datasets into compact yet informative substitutes, preserving performance comparable to the original dataset while reducing storage, transmission costs, and computational consumption. However, previous DD methods mainly focus on distilling information from images, often overlooking the semantic information inherent in the data. The disregard for context hinders the model's generalization ability, particularly in tasks involving complex datasets, which may result in illogical outputs or the omission of critical objects. In this study, we integrate vision-language methods into DD by introducing text prototypes to distill language information and collaboratively synthesize data with image prototypes, thereby enhancing dataset distillation performance. Notably, the text prototypes utilized in this study are derived from descriptive text information generated by an open-source large language model. This framework demonstrates broad applicability across datasets without pre-existing text descriptions, expanding the potential of dataset distillation beyond traditional image-based approaches. Compared to other methods, the proposed approach generates logically coherent images containing target objects, achieving state-of-the-art validation performance and demonstrating robust generalization. Source code and generated data are available in https://github.com/zou-yawen/Dataset-Distillation-via-Vision-Language-Category-Prototype/

数据蒸馏视觉语言原型学习泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。