通过分层生成增强数据蒸馏中的语义结构,提升小规模数据集表现。
HIERAMP: Coarse-to-Fine Autoregressive Amplification for Generative Dataset Distillation
- 利用视觉自回归模型分层生成,逐级放大关键语义特征。
- 在粗粒度层面促进多样布局,在细粒度层面聚焦关键细节。
- 无需优化全局相似性,即可显著提升蒸馏数据验证性能。
数据蒸馏通常仅关注全局语义相似性来生成小规模替代数据集,但物体语义具有固有的层次性。例如,鸟的眼睛位置和外观受头部轮廓约束。仅依赖全局相似性难以捕捉不同层级的结构对识别的支持作用。本文研究层次语义在有效数据蒸馏中的贡献,采用具备粗到细生成能力的视觉自回归(VAR)模型,提出HIERAMP方法,在每个VAR尺度上注入类别标记以动态识别显著区域,并利用其生成的激活图引导该尺度的语义放大。该方法仅增加少量推理开销,却能引导合成过程聚焦于判别性部分与结构。实验表明,语义放大使粗粒度对象布局的标记选择更具多样性,而细粒度阶段则集中使用标记,强化对物体相关细节的关注。在多个主流数据蒸馏基准上,HIERAMP在不显式优化全局相似性的情况下持续提升验证性能,证明了语义放大对高效数据蒸馏的重要性。
原文摘要 · Abstract (English)
Dataset distillation often prioritizes global semantic proximity when creating small surrogate datasets for original large-scale ones. However, object semantics are inherently hierarchical. For example, the position and appearance of a bird's eyes are constrained by the outline of its head. Global proximity alone fails to capture how object-relevant structures at different levels support recognition. In this work, we investigate the contributions of hierarchical semantics to effective distilled data. We leverage the vision autoregressive (VAR) model whose coarse-to-fine generation mirrors this hierarchy and propose HIERAMP to amplify semantics at different levels. At each VAR scale, we inject class tokens that dynamically identify salient regions and use their induced maps to guide amplification at that scale. This adds only marginal inference cost while steering synthesis toward discriminative parts and structures. Empirically, we find that semantic amplification leads to more diverse token choices in constructing coarse-scale object layouts. Conversely, at fine scales, the amplification concentrates token usage, increasing focus on object-related details. Across popular dataset distillation benchmarks, HIERAMP consistently improves validation performance without explicitly optimizing global proximity, demonstrating the importance of semantic amplification for effective dataset distillation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。