arXiv:2601.05335math.NAcs.LG2026-01

提出可处理任意对称性的广义张量分解方法,提升低秩建模精度与效率。

Generalized Canonical Polyadic Tensor Decompositions with General Symmetry

  • 通过在分解中显式引入对称性约束,增强张量结构建模能力。
  • 推导出可高效计算的梯度形式,支持批量与随机优化算法。
  • 适用于动态图、社交网络等具有对称结构的大规模张量数据。

标准张量分解(CP)通过最小二乘损失拟合低秩张量,是发现张量数据中潜在低维结构的核心方法。广义CP(GCP)通过引入更灵活的损失函数,能更好地处理二值数据、计数数据或抗异常值,但未显式考虑张量中的对称性。在现代应用中,如动态图的邻接矩阵堆叠张量,常在节点维度上存在对称性。本文提出对称广义CP(SymGCP),支持任意模式子集上的对称性约束,通过在分解中强制对称性来建模此类结构。我们推导了适用于所有一次性优化的梯度表达式,结合现有张量核函数实现高效计算;同时基于梯度形式设计多种随机近似算法,支持大规模张量的扩展。在合成与真实数据上的实验验证了SymGCP的有效性与可扩展性。

原文摘要 · Abstract (English)

Canonical Polyadic (CP) tensor decomposition is a workhorse algorithm for discovering underlying low-dimensional structure in tensor data. This is accomplished in conventional CP decomposition by fitting a low-rank tensor to data with respect to the least-squares loss. Generalized CP (GCP) decompositions generalize this approach by allowing general loss functions that can be more appropriate, e.g., to model binary and count data or to improve robustness to outliers. However, GCP decompositions do not explicitly account for any symmetry in the tensors, which commonly arises in modern applications. For example, a tensor formed by stacking the adjacency matrices of a dynamic graph over time will naturally exhibit symmetry along the two modes corresponding to the graph nodes. In this paper, we develop a symmetric GCP (SymGCP) decomposition that allows for general forms of symmetry, i.e., symmetry along any subset of the modes. SymGCP accounts for symmetry by enforcing the corresponding symmetry in the decomposition. We derive gradients for SymGCP that enable its efficient computation via all-at-once optimization with existing tensor kernels. The form of the gradients also leads to various stochastic approximations that enable us to develop stochastic SymGCP algorithms that can scale to large tensors. We demonstrate the utility of the proposed SymGCP algorithms with a variety of experiments on both synthetic and real data.

张量分解对称性广义模型高效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。