arXiv:2506.16735cs.CVeess.IV2025-06

通过三维深度低秩张量表示,提升高光谱图像修复效果

3DeepRep: 3D Deep Low-rank Tensor Representation for Hyperspectral Image Inpainting

  • 在三个方向上进行深度非线性变换,捕捉多维低秩结构
  • 相比现有方法,在真实数据集上实现更优的修复质量
  • 适合需要高精度修复的遥感图像处理任务

基于变换的张量核范数(TNN)方法在利用潜在表示中的低秩结构方面展现出显著效果。近期工作引入深度变换以增强低秩张量表示,但多数方法仅限于光谱模式,忽略了其他张量模式的低秩特性。本文提出一种新型三方向深度低秩张量表示模型(3DeepRep),在高光谱图像张量的三个模式上均执行深度非线性变换。为约束低秩性,模型对每个方向(i=1,2,3)在对应潜在空间中最小化模式-i切片的核范数,形成三方向TNN正则化。三个方向分支输出通过可学习聚合模块融合,生成最终结果。采用基于梯度的自监督优化算法求解该模型。在多个真实高光谱图像数据集上的大量实验表明,所提方法在定性和定量指标上均优于现有最先进技术。

原文摘要 · Abstract (English)

Recent approaches based on transform-based tensor nuclear norm (TNN) have demonstrated notable effectiveness in hyperspectral image (HSI) inpainting by leveraging low-rank structures in latent representations. Recent developments incorporate deep transforms to improve low-rank tensor representation; however, existing approaches typically restrict the transform to the spectral mode, neglecting low-rank properties along other tensor modes. In this paper, we propose a novel 3-directional deep low-rank tensor representation (3DeepRep) model, which performs deep nonlinear transforms along all three modes of the HSI tensor. To enforce low-rankness, the model minimizes the nuclear norms of mode-i frontal slices in the corresponding latent space for each direction (i=1,2,3), forming a 3-directional TNN regularization. The outputs from the three directional branches are subsequently fused via a learnable aggregation module to produce the final result. An efficient gradient-based optimization algorithm is developed to solve the model in a self-supervised manner. Extensive experiments on real-world HSI datasets demonstrate that the proposed method achieves superior inpainting performance compared to existing state-of-the-art techniques, both qualitatively and quantitatively.

高光谱图像张量表示低秩修复深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。