让无数据蒸馏更好理解图像结构,提升分割精度
Seeing the Whole Picture: Distribution-Guided Data-Free Distillation for Semantic Segmentation
- 用教师模型的批量归一化统计量指导数据采样
- 在Cityscapes上达到73.1% mIoU,优于现有方法
- 适合缺乏标注数据但需高质量分割的场景
语义分割需要对物理世界有整体理解,因为它为空间连续且结构连贯的对象分配语义标签,而非孤立像素。然而,现有的无数据知识蒸馏(DFKD)方法主要针对分类任务设计,常忽略这种连续性,直接应用于分割任务时性能显著下降。本文提出专为分割设计的无数据蒸馏框架DFSS。不同于以往将像素独立处理的方法,DFSS尊重真实场景的结构与上下文连续性。核心思想是利用教师模型的批归一化(BN)统计量引导近似分布采样(ADS),在不依赖可能误导的教师预测的情况下,选择更贴近原始训练分布的数据。此外,提出加权分布渐进蒸馏(WDPD),在训练初期优先选择与原始数据分布更一致的可靠样本,逐步引入更具挑战性的样本,模拟人类感知的学习过程。大量实验表明,DFSS在标准基准上持续优于现有无数据蒸馏方法,实现顶尖性能,且对辅助数据依赖显著降低。
原文摘要 · Abstract (English)
Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing data-free knowledge distillation (DFKD) methods-primarily designed for classification-often disregard this continuity, resulting in significant performance degradation when applied directly to segmentation tasks. In this paper, we introduce DFSS, a novel data-free distillation framework tailored for semantic segmentation. Unlike prior approaches that treat pixels independently, DFSS respects the structural and contextual continuity of real-world scenes. Our key insight is to leverage Batch Normalization (BN) statistics from a teacher model to guide Approximate Distribution Sampling (ADS), enabling the selection of data that better reflects the original training distribution-without relying on potentially misleading teacher predictions. Additionally, we propose Weighted Distribution Progressive Distillation (WDPD), which dynamically prioritizes reliable samples that are more closely aligned with the original data distribution early in training and gradually incorporates more challenging cases, mirroring the natural progression of learning in human perception. Extensive experiments on standard benchmarks demonstrate that DFSS consistently outperforms existing data-free distillation methods for semantic segmentation, achieving state-of-the-art results with significantly reduced reliance on auxiliary data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。