用扩散模型生成高保真遥感图像,大幅压缩数据量仍保持分类性能。
Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
- 基于原型引导的扩散模型生成代表性遥感图像
- 在三个基准上仅用1%原始数据量达到90%以上准确率
- 适合需要高效训练的遥感图像分类场景
近年来,深度学习在遥感图像解析中取得显著进展,依赖大规模基准数据集。但海量数据带来巨大存储与计算开销。为此,本文首次将数据集蒸馏引入遥感图像解析领域,提出判别原型引导扩散(DPD)框架,将大规模遥感数据集压缩为紧凑且具有代表性的蒸馏数据集。为提升合成样本的语义保真度与多样性,我们在隐空间中提取每类的代表性原型,并构建围绕原型的超球面语义锚点以指导反向去噪轨迹。为进一步增强生成样本的判别性,对每个原型生成多个候选样本,通过隐空间分类器结合置信度边缘准则排序,选取最具判别性的样本构成最终蒸馏数据集。在三个高分辨率遥感场景分类基准上的实验表明,该方法可生成真实、多样且具备强判别性的下游训练样本。代码与预训练模型已公开(https://github.com/YonghaoXu/DPD)。
原文摘要 · Abstract (English)
Recent years have witnessed the remarkable success of deep learning in remote sensing image interpretation, driven by the availability of large-scale benchmark datasets. However, this reliance on massive training data also brings substantial storage and computational costs. To address this challenge, this study introduces the concept of dataset distillation into the field of remote sensing image interpretation for the first time. Specifically, we propose discriminative prototype-guided diffusion (DPD), a diffusion-based generative distillation framework that condenses a large-scale remote sensing dataset into a compact and representative distilled dataset. To improve the semantic fidelity and diversity of the synthesized samples, we extract representative prototypes for each category in the latent space. We then construct hyperspherical semantic anchors around the prototypes to guide the reverse denoising trajectory. Furthermore, to enhance the discriminative quality of the generated samples, multiple candidates are generated for each prototype and ranked by a latent classifier using a logit-margin criterion, with the most discriminative candidates selected to form the final distilled dataset. Experiments on three high-resolution remote sensing scene classification benchmarks show that the proposed method can distill realistic, diverse, and discriminative samples for downstream model training. Code and pre-trained models are available online (https://github.com/YonghaoXu/DPD).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。