通过动态选区提升图像关键信息保留,生成更紧凑高效的合成数据集。
Foreground-Aware Dataset Distillation via Dynamic Patch Selection
- 基于前景感知的动态补丁选择策略,智能识别核心物体区域。
- 在多个基准上优于现有方法,显著提升模型泛化能力与数据压缩效率。
- 适合需要高效训练大模型且关注主体信息保留的研究者使用。
针对大规模深度模型训练成本高的问题,本文提出一种前景感知的数据集蒸馏方法,通过内容自适应的补丁选择机制提升合成数据质量。传统优化方法存在计算开销大、内存受限及生成噪声图像等问题;近期非优化方法虽缓解部分缺陷,但固定补丁选择仍会丢失主体关键信息。为此,我们利用 Grounded SAM2 识别前景并计算每张图像的前景占比,据此设定类别级补丁选择阈值。在此指导下,设计双路径策略:当前景占主导时直接缩放全图,否则从候选补丁中选取最富信息量的局部区域。该机制有效保留主要物体信息,减少冗余背景。在多个基准上的实验表明,本方法持续优于现有方案,生成更具代表性与信息量的合成数据集,并增强对不同架构与图像构型的鲁棒性。
原文摘要 · Abstract (English)
In this paper, we propose a foreground-aware dataset distillation method that enhances patch selection in a content-adaptive manner. With the rising computational cost of training large-scale deep models, dataset distillation has emerged as a promising approach for constructing compact synthetic datasets that retain the knowledge of their large original counterparts. However, traditional optimization-based methods often suffer from high computational overhead, memory constraints, and the generation of unrealistic, noise-like images with limited architectural generalization. Recent non-optimization methods alleviate some of these issues by constructing distilled data from real image patches, but the used rigid patch selection strategies can still discard critical information about the main objects. To solve this problem, we first leverage Grounded SAM2 to identify foreground objects and compute per-image foreground occupancy, from which we derive a category-wise patch decision threshold. Guided by these thresholds, we design a dynamic patch selection strategy that, for each image, either selects the most informative patch from multiple candidates or directly resizes the full image when the foreground dominates. This dual-path mechanism preserves more key information about the main objects while reducing redundant background content. Extensive experiments on multiple benchmarks show that the proposed method consistently improves distillation performance over existing approaches, producing more informative and representative distilled datasets and enhancing robustness across different architectures and image compositions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。