arXiv:2603.02720cs.CV2026-03

提出可自动选择和组合分解方式的张量分析框架,提升数据结构捕捉能力。

TenExp: Mixture-of-Experts-Based Tensor Decomposition Structure Search Framework

  • 基于专家混合机制动态选择最优张量分解方式。
  • 在合成与真实数据上均优于现有方法,支持单一与混合分解。
  • 首次提供理论误差界,适合需要高精度建模的研究者。

近年来,张量分解不断涌现并受到越来越多关注。如何选择合适的张量分解以精确捕捉数据背后的低秩结构,是该领域核心挑战且研究尚不充分。现有结构搜索方法受限于固定因子交互形式(如张量收缩),无法实现多种分解的混合。为此,我们设计了一种基于专家混合的张量分解结构搜索框架(称为TenExp),可在无监督条件下动态选择并激活合适的张量分解方式。该框架具有两大优势:其一,可超越固定因子交互族,提供更优的单一分解;其二,可输出多种分解的合理混合。理论上,我们给出了TenExp的近似误差界,揭示其逼近能力。在合成与真实数据集上的大量实验表明,所提出的TenExp显著优于当前最先进的张量分解方法。

原文摘要 · Abstract (English)

Recently, tensor decompositions continue to emerge and receive increasing attention. Selecting a suitable tensor decomposition to exactly capture the low-rank structures behind the data is at the heart of the tensor decomposition field, which remains a challenging and relatively under-explored problem. Current tensor decomposition structure search methods are still confined by a fixed factor-interaction family (e.g., tensor contraction) and cannot deliver the mixture of decompositions. To address this problem, we elaborately design a mixture-of-experts-based tensor decomposition structure search framework (termed as TenExp), which allows us to dynamically select and activate suitable tensor decompositions in an unsupervised fashion. This framework enjoys two unique advantages over the state-of-the-art tensor decomposition structure search methods. Firstly, TenExp can provide a suitable single decomposition beyond a fixed factor-interaction family. Secondly, TenExp can deliver a suitable mixture of decompositions beyond a single decomposition. Theoretically, we also provide the approximation error bound of TenExp, which reveals the approximation capability of TenExp. Extensive experiments on both synthetic and realistic datasets demonstrate the superiority of the proposed TenExp compared to the state-of-the-art tensor decomposition-based methods.

张量分解专家混合结构搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。