用物理模型指导,精准区分并修复遥感图像的多种退化问题。
PhyDAE: Physics-Guided Degradation-Adaptive Experts for All-in-One Remote Sensing Image Restoration
- 分两阶段提取退化特征,结合几何与频域分析实现精准识别。
- 在三个数据集上全面超越现有方法,参数量和计算量显著降低。
- 适合需要高效高质图像修复的遥感应用,如环境监测与灾害评估。
遥感图像在获取过程中不可避免地受到大气干扰、传感器限制和成像条件等多种退化因素影响。这些复杂且异构的退化给图像质量及下游任务带来严峻挑战。针对现有全功能修复方法过度依赖隐式特征表示、缺乏退化物理建模的问题,本文提出物理引导的退化自适应专家网络(PhyDAE)。该方法采用两级级联架构,将退化信息从隐式特征转化为显式决策信号,实现对雾霾、噪声、模糊和低光照等多种异构退化的精准识别与差异化处理。模型引入渐进式退化挖掘与利用机制,通过残差流形投影器(RMP)和频域感知退化分解器(FADD),从流形几何与频率角度全面分析退化特性。设计了物理感知专家模块与温度控制稀疏激活策略,在保障成像物理一致性的同时提升计算效率。在三个基准数据集(MD-RSID、MD-RRSHID、MDRS-Landsat)上的大量实验表明,PhyDAE在全部四项修复任务中均取得优异性能,显著优于当前最优方法。尤其在保持高质量修复的同时,参数量与计算复杂度大幅降低,相较主流方法实现显著效率提升,达到性能与效率的最佳平衡。代码已开源:https://github.com/HIT-SIRS/PhyDAE。
原文摘要 · Abstract (English)
Remote sensing images inevitably suffer from various degradation factors during acquisition, including atmospheric interference, sensor limitations, and imaging conditions. These complex and heterogeneous degradations pose severe challenges to image quality and downstream interpretation tasks. Addressing limitations of existing all-in-one restoration methods that overly rely on implicit feature representations and lack explicit modeling of degradation physics, this paper proposes Physics-Guided Degradation-Adaptive Experts (PhyDAE). The method employs a two-stage cascaded architecture transforming degradation information from implicit features into explicit decision signals, enabling precise identification and differentiated processing of multiple heterogeneous degradations including haze, noise, blur, and low-light conditions. The model incorporates progressive degradation mining and exploitation mechanisms, where the Residual Manifold Projector (RMP) and Frequency-Aware Degradation Decomposer (FADD) comprehensively analyze degradation characteristics from manifold geometry and frequency perspectives. Physics-aware expert modules and temperature-controlled sparse activation strategies are introduced to enhance computational efficiency while ensuring imaging physics consistency. Extensive experiments on three benchmark datasets (MD-RSID, MD-RRSHID, and MDRS-Landsat) demonstrate that PhyDAE achieves superior performance across all four restoration tasks, comprehensively outperforming state-of-the-art methods. Notably, PhyDAE substantially improves restoration quality while achieving significant reductions in parameter count and computational complexity, resulting in remarkable efficiency gains compared to mainstream approaches and achieving optimal balance between performance and efficiency. Code is available at https://github.com/HIT-SIRS/PhyDAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。