针对遥感图像细节复杂,提出异构专家混合模型提升超分辨率效果。
Heterogeneous Mixture of Experts for Remote Sensing Image Super-Resolution
- 设计多组异构专家,每组内同质、组间异质,适配不同地物类型。
- 在UCMerced和AID数据集上,重建精度优于现有方法。
- 双路由机制按像素动态选择最优专家,适合复杂遥感图像处理。
遥感图像超分辨率旨在从低分辨率输入重建高分辨率图像,以克服传感器与成像条件的限制。然而,遥感图像固有的多样性地物类型和复杂细节给高质量重建带来挑战。现有方法通常采用统一结构处理各类地物,难以适应其复杂特性。为此,本文引入混合专家(MoE)模型,设计一组异构专家,将专家分为多个组,组内同质、组间异构,使专用激活参数可有效处理地物多样性和细节复杂性。为更好适配异构专家,提出多层次特征聚合策略引导路由过程,并设计双路由机制,自适应为每个像素选择最优专家。在UCMerced和AID数据集上的实验表明,所提方法在超分辨率重建精度上优于当前最优方法。代码将开源于https://github.com/Mr-Bamboo/MFG-HMoE。
原文摘要 · Abstract (English)
Remote sensing image super-resolution (SR) aims to reconstruct high-resolution remote sensing images from low-resolution inputs, thereby addressing limitations imposed by sensors and imaging conditions. However, the inherent characteristics of remote sensing images, including diverse ground object types and complex details, pose significant challenges to achieving high-quality reconstruction. Existing methods typically employ a uniform structure to process various types of ground objects without distinction, making it difficult to adapt to the complex characteristics of remote sensing images. To address this issue, we introduce a Mixture of Experts (MoE) model and design a set of heterogeneous experts. These experts are organized into multiple expert groups, where experts within each group are homogeneous while being heterogeneous across groups. This design ensures that specialized activation parameters can be employed to handle the diverse and intricate details of ground objects effectively. To better accommodate the heterogeneous experts, we propose a multi-level feature aggregation strategy to guide the routing process. Additionally, we develop a dual-routing mechanism to adaptively select the optimal expert for each pixel. Experiments conducted on the UCMerced and AID datasets demonstrate that our proposed method achieves superior SR reconstruction accuracy compared to state-of-the-art methods. The code will be available at https://github.com/Mr-Bamboo/MFG-HMoE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。