用概率模型提升高光谱与多光谱图像融合的精度与鲁棒性
Bayesian Fully-Connected Tensor Network for Hyperspectral-Multispectral Image Fusion
- 引入贝叶斯框架与稀疏先验,建模空间-光谱结构关联
- 在多个数据集上实现领先融合效果,对噪声和退化更鲁棒
- 减少人工调参,适合真实复杂场景下的图像融合应用
张量分解是数据分析的强大工具,已被广泛应用于高光谱-多光谱图像融合(HMF)。现有基于张量分解的方法通常依赖于数据向量化/重排,或对因子张量的排列施加刚性约束,损害了空间-光谱结构的保留及跨维度相关性的建模。尽管最近采用全连接张量网络(FCTN)的进展部分缓解了这些问题,但将数据重组为高阶张量的过程仍破坏了内在的空间-光谱结构。此外,这些方法需要大量手动参数调整,且对噪声和空间退化敏感。为此,我们提出贝叶斯全连接张量网络(BFCTN)方法。在该概率框架中,通过分层稀疏先验刻画物理元素的稀疏性,建立因子张量间的联系。该框架显式建模了空间结构、光谱特征与局部场景同质性之间的内在物理耦合。针对模型学习,我们提出了基于变分贝叶斯推断(VB)和期望最大化(EM)算法的参数估计方法,显著减少了对人工调参的需求。大量实验表明,BFCTN不仅实现了最先进的融合精度和强鲁棒性,还在复杂真实场景中展现出良好的实用性。
原文摘要 · Abstract (English)
Tensor decomposition is a powerful tool for data analysis and has been extensively employed in the field of hyperspectral-multispectral image fusion (HMF). Existing tensor decomposition-based fusion methods typically rely on disruptive data vectorization/reshaping or impose rigid constraints on the arrangement of factor tensors, hindering the preservation of spatial-spectral structures and the modeling of cross-dimensional correlations. Although recent advances utilizing the Fully-Connected Tensor Network (FCTN) decomposition have partially alleviated these limitations, the process of reorganizing data into higher-order tensors still disrupts the intrinsic spatial-spectral structure. Furthermore, these methods necessitate extensive manual parameter tuning and exhibit limited robustness against noise and spatial degradation. To alleviate these issues, we propose the Bayesian FCTN (BFCTN) method. Within this probabilistic framework, a hierarchical sparse prior that characterizing the sparsity of physical elements, establishes connections between the factor tensors. This framework explicitly models the intrinsic physical coupling among spatial structures, spectral signatures, and local scene homogeneity. For model learning, we develop a parameter estimation method based on Variational Bayesian inference (VB) and the Expectation-Maximization (EM) algorithm, which significantly reduces the need for manual parameter tuning. Extensive experiments demonstrate that BFCTN not only achieves state-of-the-art fusion accuracy and strong robustness but also exhibits practical applicability in complex real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。