提出可学习正交变换的低秩模型,提升多维逆问题重建效果。
OTLRM: Orthogonal Learning-based Low-Rank Metric for Multi-Dimensional Inverse Problems
- 基于可学习正交变换构建新低秩模型,兼容神经网络训练。
- 在多光谱图像、视频重建等任务中显著提升恢复质量。
- 适合做图像/视频修复、压缩感知等多维数据处理的研究者。
现实场景中,多光谱图像和多帧视频等复杂数据天然具备强低秩特性,这对张量补全、光谱成像重建和多光谱图像去噪等多维逆问题至关重要。现有张量奇异值分解(t-SVD)依赖手工设计或预设变换,难以灵活定义张量核范数(TNN)。TNN正则化优化通常采用奇异值阈值化(SVT)算子求解,但其在深度神经网络中因特征向量导数数值不稳定性而难应用。本文提出一种基于可学习正交变换的数据驱动生成式低秩t-SVD模型,可在其表示下自然求解。受Householder变换线性代数理论启发,构造内生正交矩阵以适应神经网络,并优化为任意正交矩阵。同时,提出一种通用的低秩求解器,利用生成网络高效获得低秩结构。大量实验验证了其在重建性能上的显著提升。
原文摘要 · Abstract (English)
In real-world scenarios, complex data such as multispectral images and multi-frame videos inherently exhibit robust low-rank property. This property is vital for multi-dimensional inverse problems, such as tensor completion, spectral imaging reconstruction, and multispectral image denoising. Existing tensor singular value decomposition (t-SVD) definitions rely on hand-designed or pre-given transforms, which lack flexibility for defining tensor nuclear norm (TNN). The TNN-regularized optimization problem is solved by the singular value thresholding (SVT) operator, which leverages the t-SVD framework to obtain the low-rank tensor. However, it is quite complicated to introduce SVT into deep neural networks due to the numerical instability problem in solving the derivatives of the eigenvectors. In this paper, we introduce a novel data-driven generative low-rank t-SVD model based on the learnable orthogonal transform, which can be naturally solved under its representation. Prompted by the linear algebra theorem of the Householder transformation, our learnable orthogonal transform is achieved by constructing an endogenously orthogonal matrix adaptable to neural networks, optimizing it as arbitrary orthogonal matrices. Additionally, we propose a low-rank solver as a generalization of SVT, which utilizes an efficient representation of generative networks to obtain low-rank structures. Extensive experiments highlight its significant restoration enhancements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。