arXiv:2502.09928cs.CVcs.AI2025-02NeurIPS被引 4

提出新型树状张量网络,高效捕捉高阶特征交互。

Deep Tree Tensor Networks

  • 构建树形张量网络结构,通过多线性运算捕获2^L阶特征交互
  • 在多个数据集上超越现有方法,参数共享设计提升效率
  • 理论证明其与多项式网络等价,推动可解释性研究

源自量子物理的张量网络(TN)被广泛用作指数级模型和参数分解器。传统模型如矩阵乘积态(MPS)在自然图像识别中尚未取得成功,通常仅用于压缩已有网络参数,丧失了捕捉指数级特征交互的能力。本文提出新型架构——深度树张量网络(DTTN),通过多线性运算捕获2^L阶乘法交互,本质为具有参数共享特性的树状拓扑。DTTN由多个反对称交互模块(AIMs)堆叠而成,实现高效计算。理论分析表明,在特定条件下,量子启发的TN模型与多项式/多线性网络等价。实验验证该模型在多个基准测试中表现优于同类方法及当前先进架构。代码已开源。

原文摘要 · Abstract (English)

Originating in quantum physics, tensor networks (TNs) have been widely adopted as exponential machines and parametric decomposers for recognition tasks. Typical TN models, such as Matrix Product States (MPS), have not yet achieved successful application in natural image recognition. When employed, they primarily serve to compress parameters within pre-existing networks, thereby losing their distinctive capability to capture exponential-order feature interactions. This paper introduces a novel architecture named \textit{\textbf{D}eep \textbf{T}ree \textbf{T}ensor \textbf{N}etwork} (DTTN), which captures $2^L$-order multiplicative interactions across features through multilinear operations, while essentially unfolding into a \emph{tree}-like TN topology with the parameter-sharing property. DTTN is stacked with multiple antisymmetric interaction modules (AIMs), and this design facilitates efficient implementation. Furthermore, our theoretical analysis demonstrates the equivalence between quantum-inspired TN models and polynomial/multilinear networks under specific conditions. We posit that the DTTN could catalyze more interpretable research within this field. The proposed model is evaluated across multiple benchmarks and domains, demonstrating superior performance compared to both peer methods and state-of-the-art architectures. Our code is publicly available at https://github.com/NieCha/deep_tree_tensor_network.

张量网络特征交互深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。