提出MatrixConv网络,让高光谱解混更物理可信、结果更准确。
Neural Network for Blind Unmixing: a novel MatrixConv Unmixing (MCU) Approach
- 用可解的迭代算法构造双分支网络,分别估计端元和含量。
- 在真实与合成数据上验证,解混精度显著优于传统方法。
- 适合需要物理合理性的高光谱图像分析任务,如遥感监测。
高光谱图像(HSI)解混旨在通过分析高光谱相机捕获的图像,识别场景中的组成成分(称作端元)及其对应比例(称作含量)。近年来,随着机器学习技术的发展,尤其是卷积神经网络(CNN)的兴起,基于深度学习的解混方法被广泛提出。然而,这些方法面临两大挑战:1. 结果常缺乏物理意义,例如出现未知或不存在的物质光谱;2. CNN作为通用网络结构,并未专门针对解混任务设计。为应对这些问题,本文受双深度图像先验(DIP)和算法展开思想启发,提出一种新型网络结构——矩阵卷积解混(MCU),用于分别估计端元和含量。该方法基于可迭代求解的优化器,将其展开为两个子网络:端元估计DIP(UEDIP)和含量估计DIP(UADIP),分别生成端元与含量的估计。整体网络由这两个子网络构成。为获得有意义的解混结果,还设计了复合损失函数,并分别为端元与含量引入显式正则项以提升质量。所提方法在合成与真实数据集上均进行了有效性测试。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) unmixing is a challenging research problem that tries to identify the constituent components, known as endmembers, and their corresponding proportions, known as abundances, in the scene by analysing images captured by hyperspectral cameras. Recently, many deep learning based unmixing approaches have been proposed with the surge of machine learning techniques, especially convolutional neural networks (CNN). However, these methods face two notable challenges: 1. They frequently yield results lacking physical significance, such as signatures corresponding to unknown or non-existent materials. 2. CNNs, as general-purpose network structures, are not explicitly tailored for unmixing tasks. In response to these concerns, our work draws inspiration from double deep image prior (DIP) techniques and algorithm unrolling, presenting a novel network structure that effectively addresses both issues. Specifically, we first propose a MatrixConv Unmixing (MCU) approach for endmember and abundance estimation, respectively, which can be solved via certain iterative solvers. We then unroll these solvers to build two sub-networks, endmember estimation DIP (UEDIP) and abundance estimation DIP (UADIP), to generate the estimation of endmember and abundance, respectively. The overall network is constructed by assembling these two sub-networks. In order to generate meaningful unmixing results, we also propose a composite loss function. To further improve the unmixing quality, we also add explicitly a regularizer for endmember and abundance estimation, respectively. The proposed methods are tested for effectiveness on both synthetic and real datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。