提出新张量乘积,大幅降低大尺度多维数据计算开销。
Projected Tensor-Tensor Products for Efficient Computation of Optimal Multiway Data Representations
- 用列正交的瘦高矩阵替代原需可逆矩阵,降低计算复杂度。
- 理论证明压缩表示在投影框架下仍具最优性,且优于非矩阵类比方法。
- 适用于视频、高光谱成像等大规模多维数据处理任务。
张量分解已成为多维数据特征提取与压缩的重要工具。近期张量算子的发展使标准矩阵代数的优良性质得以保留在多线性分解中。然而,这一矩阵类比张量运算依赖于一个大小随数据维度平方增长的可逆矩阵,导致大规模多维数据处理时应用与求逆成本过高,压缩表示的构建与存储效率低下。本文提出一种新的投影张量-张量乘积,放宽可逆性限制以减少计算开销,同时保持基本线性代数性质。该变换基于仅随数据某些维度线性增长的列正交瘦高矩阵,使计算复杂度降低一个数量级。我们提供了详尽的理论证明,表明投影乘积框架内具备矩阵类比性及压缩表示的最优性。进一步证明,基于投影乘积的近似方法优于一种同类非矩阵类比张量分解。数值实验在视频与高光谱成像数据上验证了理论结论,并展示了投影乘积的实际优势。
原文摘要 · Abstract (English)
Tensor decompositions have become essential tools for feature extraction and compression of multiway data. Recent advances in tensor operators have enabled desirable properties of standard matrix algebra to be retained for multilinear factorizations. Behind this matrix-mimetic tensor operation is an invertible matrix whose size depends quadratically on certain dimensions of the data. As a result, for large-scale multiway data, the invertible matrix can be computationally demanding to apply and invert and can lead to inefficient tensor representations in terms of construction and storage costs. In this work, we propose a new projected tensor-tensor product that relaxes the invertibility restriction to reduce computational overhead and still preserves fundamental linear algebraic properties. The transformation behind the projected product is a tall-and-skinny matrix with unitary columns, which depends only linearly on certain dimensions of the data, thereby reducing computational complexity by an order of magnitude. We provide extensive theory to prove the matrix mimeticity and the optimality of compressed representations within the projected product framework. We further prove that projected-product-based approximations outperform a comparable, non-matrix-mimetic tensor factorization. We support the theoretical findings and demonstrate the practical benefits of projected products through numerical experiments on video and hyperspectral imaging data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。