arXiv:2508.12261cs.CV2025-08

用超像素提升多维数据恢复精度,兼顾语义与灵活性

Superpixel-informed Continuous Low-Rank Tensor Representation for Multi-Dimensional Data Recovery

  • 以超像素为单元替代传统网格,更贴合真实数据分布
  • 在多光谱图像等数据上实现3-5 dB的PSNR提升
  • 适合处理有复杂空间变化的视频、图像等多维数据

低秩张量表示(LRTR)是多维数据处理的强大工具,但传统方法存在两大缺陷:一是假设整体数据为低秩,这在具有显著空间变化的真实场景中常不成立;二是局限于离散网格数据,缺乏灵活性。为此,本文提出超像素引导的连续低秩张量表示(SCTR)框架,实现超越传统网格约束的连续建模。核心创新包括:首先,利用超像素作为基本建模单元,因其语义一致性更强,更易呈现低秩特性,从而增强对多样数据流的适应性;其次,提出一种新型非对称低秩张量分解(ALTF),通过共享神经网络配合专用头模块参数化每个超像素的因子矩阵,将全局模式学习与局部自适应分离,高效捕捉跨超像素共性与超像素内差异。该表示兼具表达力与紧凑性,平衡了模型效率与适应性。在多个基准数据集上的实验表明,SCTR在多光谱图像、视频和彩色图像上相较现有LRTR方法实现3-5 dB的PSNR提升。

原文摘要 · Abstract (English)

Low-rank tensor representation (LRTR) has emerged as a powerful tool for multi-dimensional data processing. However, classical LRTR-based methods face two critical limitations: (1) they typically assume that the holistic data is low-rank, this assumption is often violated in real-world scenarios with significant spatial variations; and (2) they are constrained to discrete meshgrid data, limiting their flexibility and applicability. To overcome these limitations, we propose a Superpixel-informed Continuous low-rank Tensor Representation (SCTR) framework, which enables continuous and flexible modeling of multi-dimensional data beyond traditional grid-based constraints. Our approach introduces two main innovations: First, motivated by the observation that semantically coherent regions exhibit stronger low-rank characteristics than holistic data, we employ superpixels as the basic modeling units. This design not only encodes rich semantic information, but also enhances adaptability to diverse forms of data streams. Second, we propose a novel asymmetric low-rank tensor factorization (ALTF) where superpixel-specific factor matrices are parameterized by a shared neural network with specialized heads. By strategically separating global pattern learning from local adaptation, this framework efficiently captures both cross-superpixel commonalities and within-superpixel variations. This yields a representation that is both highly expressive and compact, balancing model efficiency with adaptability. Extensive experiments on several benchmark datasets demonstrate that SCTR achieves 3-5 dB PSNR improvements over existing LRTR-based methods across multispectral images, videos, and color images.

低秩张量超像素数据恢复神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。