提出双层次自适应加权机制,提升遥感图像融合质量
A General Adaptive Dual-level Weighting Mechanism for Remote Sensing Pansharpening
- 用协方差矩阵捕捉特征冗余与异质性,生成可学习权重
- 在通道内和层间分别加权,减少冗余、增强关键信息
- 适配多种模型,对齐主流方法性能,适合遥感图像处理研究者
当前基于深度学习的遥感全色锐化方法发展迅速,但多数方法未能充分挖掘特征异质性和冗余性,限制了性能提升。本文利用协方差矩阵建模特征异质性与冗余性,提出相关性感知协方差加权(CACW)机制,通过非线性函数生成调整权重。在此基础上,构建通用自适应双层次加权机制(ADWM),从两个层面优化:1)通道内加权(IFW)评估各特征通道间的相关性,降低冗余并增强独特信息;2)跨层加权(CFW)根据层间相关性调整各层贡献,优化最终输出。大量实验表明,ADWM优于近期先进方法。通过泛化性验证、冗余可视化、对比实验、关键变量分析及消融实验进一步证实其有效性。代码已开源。
原文摘要 · Abstract (English)
Currently, deep learning-based methods for remote sensing pansharpening have advanced rapidly. However, many existing methods struggle to fully leverage feature heterogeneity and redundancy, thereby limiting their effectiveness. We use the covariance matrix to model the feature heterogeneity and redundancy and propose Correlation-Aware Covariance Weighting (CACW) to adjust them. CACW captures these correlations through the covariance matrix, which is then processed by a nonlinear function to generate weights for adjustment. Building upon CACW, we introduce a general adaptive dual-level weighting mechanism (ADWM) to address these challenges from two key perspectives, enhancing a wide range of existing deep-learning methods. First, Intra-Feature Weighting (IFW) evaluates correlations among channels within each feature to reduce redundancy and enhance unique information. Second, Cross-Feature Weighting (CFW) adjusts contributions across layers based on inter-layer correlations, refining the final output. Extensive experiments demonstrate the superior performance of ADWM compared to recent state-of-the-art (SOTA) methods. Furthermore, we validate the effectiveness of our approach through generality experiments, redundancy visualization, comparison experiments, key variables and complexity analysis, and ablation studies. Our code is available at https://github.com/Jie-1203/ADWM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。