用扩散模型建模光谱变化,提升高光谱解混精度
Diffusion Posterior Sampler for Hyperspectral Unmixing with Spectral Variability Modeling
- 将预训练扩散模型作为后验采样器,融合先验与观测数据
- 基于超像素构建图像级端元包,避免光谱库偏差
- 在超像素层面迭代优化端元与丰度,支持光谱可变性建模
线性光谱混合模型(LMM)能将单像素中的组成物质(端元)及其比例(丰度)分离。核心挑战在于如何建模光谱先验分布与光谱可变性。在贝叶斯框架下,可通过结合观测数据与端元先验分布来推导丰度后验估计。针对上述挑战及贝叶斯框架的优势,本文提出一种基于扩散后验采样器的半盲解混方法DPS4Un,具备以下特点:(1) 将预训练的条件光谱扩散模型视为后验采样器,融合学习到的端元先验与观测数据,获得精炼的丰度分布;(2) 不使用现有光谱库作为先验,而是基于超像素构建图像级端元包,用于训练端元先验学习器;超像素确保子场景更同质;(3) 提出基于超像素的数据保真项,替代传统图像级数据一致性约束;(4) 每个超像素区域的端元初始化为高斯噪声,通过迭代更新丰度与端元,实现光谱可变性建模。在三个真实世界基准数据集上的实验表明,DPS4Un优于现有先进解混方法。
原文摘要 · Abstract (English)
Linear spectral mixture models (LMM) provide a concise form to disentangle the constituent materials (endmembers) and their corresponding proportions (abundance) in a single pixel. The critical challenges are how to model the spectral prior distribution and spectral variability. Prior knowledge and spectral variability can be rigorously modeled under the Bayesian framework, where posterior estimation of Abundance is derived by combining observed data with endmember prior distribution. Considering the key challenges and the advantages of the Bayesian framework, a novel method using a diffusion posterior sampler for semiblind unmixing, denoted as DPS4Un, is proposed to deal with these challenges with the following features: (1) we view the pretrained conditional spectrum diffusion model as a posterior sampler, which can combine the learned endmember prior with observation to get the refined abundance distribution. (2) Instead of using the existing spectral library as prior, which may raise bias, we establish the image-based endmember bundles within superpixels, which are used to train the endmember prior learner with diffusion model. Superpixels make sure the sub-scene is more homogeneous. (3) Instead of using the image-level data consistency constraint, the superpixel-based data fidelity term is proposed. (4) The endmember is initialized as Gaussian noise for each superpixel region, DPS4Un iteratively updates the abundance and endmember, contributing to spectral variability modeling. The experimental results on three real-world benchmark datasets demonstrate that DPS4Un outperforms the state-of-the-art hyperspectral unmixing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。