用轻量化扩散模型提升遥感图像超分辨率,速度提升200倍
SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation

- 通过不确定性引导的步长分配构建更强教师模型
- 参数减少20倍,推理加速200倍,保持良好视觉质量
- 适合资源受限场景的遥感图像高效重建
扩散模型在图像超分辨率(SR)中表现优异,但计算开销大,限制了其在遥感应用中的部署。为此,我们提出SlimDiffSR,一种面向真实遥感图像超分辨率的轻量级高效扩散框架。不同于依赖固定步长的单步扩散方法,我们引入不确定性引导的步长分配策略,构建更强的单步教师模型,将重建难度与扩散步长显式关联,实现生成强度自适应。在此基础上,提出专为遥感图像设计的结构化剪枝策略,系统移除冗余语义模块,替换标准操作为轻量设计,包括频域可分卷积、方向可分卷积和查询驱动的全局聚合模块,充分利用遥感数据稀疏高频细节、强方向性模式和长程空间依赖等特性。为增强知识迁移,引入最大均值差异(MMD)对齐师生模型特征分布。在多个遥感基准测试上,SlimDiffSR在效率与重建质量间取得良好平衡:相比多步扩散模型,推理加速达200倍,参数减少20倍,且在感知质量上具有竞争力,明显优于现有轻量级扩散基线。代码已开源。
原文摘要 · Abstract (English)
Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a lightweight and efficient diffusion-based framework for real-world remote sensing image super-resolution. Unlike existing single-step diffusion methods that rely on fixed timesteps, we first introduce an uncertainty-guided timestep assignment strategy to construct a stronger single-step teacher model, where reconstruction difficulty is explicitly linked to diffusion timesteps, enabling adaptive generative strength. Building upon this teacher, we further present a structured pruning strategy tailored to remote sensing imagery, which systematically removes redundant semantic modules and replaces standard operations with lightweight designs, including frequency-separable convolution, direction-separable convolution, and a query-driven global aggregation module. These components explicitly exploit the unique characteristics of remote sensing data, such as sparse high-frequency details, strong directional patterns, and long-range spatial dependencies. To enhance knowledge transfer, we incorporate Maximum Mean Discrepancy (MMD) into the distillation process to align feature distributions between the teacher and student models. Extensive experiments on multiple remote sensing benchmarks demonstrate that SlimDiffSR achieves a favorable balance between efficiency and reconstruction quality. In particular, it attains up to $200\times$ inference acceleration and a $20\times$ reduction in model parameters compared with multi-step diffusion models, while achieving competitive perceptual quality and clearly outperforming existing lightweight diffusion baselines in efficiency. The code is available at: https://github.com/wwangcece/SlimDiffSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。