用高斯点阵实现多维图像的精细表示,显著提升高频细节还原能力。
Gaussian Splatting-based Low-Rank Tensor Representation for Multi-Dimensional Image Recovery
- 用2D和1D高斯点阵分别表示潜在张量与变换矩阵,连续建模更精准。
- 在多维图像恢复任务中,对局部高频信息的捕捉优于当前最佳方法。
- 适合需要高精度重建的医学影像、遥感图像等多维数据处理场景。
张量奇异值分解(t-SVD)是多维图像表示的有力工具,能将多维图像分解为潜在张量与伴随变换矩阵。然而,t-SVD方法存在两个关键局限:(1) 潜在张量的近似(如张量分解)粗糙,难以准确捕捉空间局部高频信息;(2) 变换矩阵由固定基原子(如DFT中的复指数原子、DCT中的余弦原子)构成,无法精确刻画沿第3阶纤维的局部高频信息。为此,我们提出基于高斯点阵的低秩张量表示框架(GSLR),以紧凑且连续的方式表示多维图像。具体地,采用定制化的2D高斯点阵生成潜在张量,1D高斯点阵生成变换矩阵。二者在此框架下不可或缺且互补,具有强大的表示能力,尤其擅长捕捉局部高频信息。为评估所提GSLR的表示性能,我们构建了基于GSLR的无监督多维图像恢复模型。在多维图像恢复任务上的大量实验表明,GSLR持续优于现有最先进方法,特别是在局部高频信息的还原上表现突出。
原文摘要 · Abstract (English)
Tensor singular value decomposition (t-SVD) is a promising tool for multi-dimensional image representation, which decomposes a multi-dimensional image into a latent tensor and an accompanying transform matrix. However, two critical limitations of t-SVD methods persist: (1) the approximation of the latent tensor (e.g., tensor factorizations) is coarse and fails to accurately capture spatial local high-frequency information; (2) The transform matrix is composed of fixed basis atoms (e.g., complex exponential atoms in DFT and cosine atoms in DCT) and cannot precisely capture local high-frequency information along the mode-3 fibers. To address these two limitations, we propose a Gaussian Splatting-based Low-rank tensor Representation (GSLR) framework, which compactly and continuously represents multi-dimensional images. Specifically, we leverage tailored 2D Gaussian splatting and 1D Gaussian splatting to generate the latent tensor and transform matrix, respectively. The 2D and 1D Gaussian splatting are indispensable and complementary under this representation framework, which enjoys a powerful representation capability, especially for local high-frequency information. To evaluate the representation ability of the proposed GSLR, we develop an unsupervised GSLR-based multi-dimensional image recovery model. Extensive experiments on multi-dimensional image recovery demonstrate that GSLR consistently outperforms state-of-the-art methods, particularly in capturing local high-frequency information.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。