提出多粒度非局部自相似先验,提升高光谱图像修复适应性。
Hyperspectral Image Recovery Constrained by Multi-Granularity Non-Local Self-Similarity Priors
- 分粗粒度与细粒度分解,联合捕捉全局结构与局部细节。
- 在像素、条带缺失场景下均实现优异恢复效果。
- 适合需要高鲁棒性图像修复的研究与应用者。
高光谱图像(HSI)恢复作为上游图像处理任务,对分类、分割和检测等下游任务具有重要意义。近年来基于非局部先验表示的HSI恢复方法表现突出,但其采用固定格式张量表示非局部自相似性,难以适应多样缺失场景。为此,本文首次引入张量分解中的粒度概念,提出一种受多粒度非局部自相似性先验约束的HSI恢复模型。该模型交替对非局部自相似性张量组进行粗粒度与细粒度分解:粗粒度分解基于Tucker张量分解,通过对模式展开矩阵进行奇异值收缩提取图像全局结构信息;细粒度分解采用FCTN分解,通过建模因子张量间的成对相关性捕捉局部细节信息。该架构实现了对HSI全局、局部及非局部先验的统一表征。实验结果表明,该模型具有强适用性,在像素缺失、条带缺失等多种缺失场景下均表现出卓越恢复效果。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) recovery, as an upstream image processing task, holds significant importance for downstream tasks such as classification, segmentation, and detection. In recent years, HSI recovery methods based on non-local prior representations have demonstrated outstanding performance. However, these methods employ a fixed-format factor to represent the non-local self-similarity tensor groups, making them unable to adapt to diverse missing scenarios. To address this issue, we introduce the concept of granularity in tensor decomposition for the first time and propose an HSI recovery model constrained by multi-granularity non-local self-similarity priors. Specifically, the proposed model alternately performs coarse-grained decomposition and fine-grained decomposition on the non-local self-similarity tensor groups. Among them, the coarse-grained decomposition builds upon Tucker tensor decomposition, which extracts global structural information of the image by performing singular value shrinkage on the mode-unfolded matrices. The fine-grained decomposition employs the FCTN decomposition, capturing local detail information through modeling pairwise correlations among factor tensors. This architectural approach achieves a unified representation of global, local, and non-local priors for HSIs. Experimental results demonstrate that the model has strong applicability and exhibits outstanding recovery effects in various types of missing scenes such as pixels and stripes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。