arXiv:2504.13975cs.LGcs.AI2025-04被引 2

提出新型多尺度张量求和层,提升高维数据处理效率与性能。

Multiscale Tensor Summation Factorization as a New Neural Network Layer (MTS Layer) for Multidimensional Data Processing

  • 通过多尺度张量分解实现跨维度高效计算,替代传统全连接层。
  • 参数量减少显著,且在分类、压缩等任务中优于传统CNN和MLP。
  • 适配现代非线性模块,适用于计算机视觉领域高性能模型设计。

多层感知机(MLP)通过可学习权重矩阵进行向量-矩阵乘法,但在计算机视觉等高维任务中因参数量过大而受限。卷积操作虽能共享权重,但感受野有限。本文提出多尺度张量求和(MTS)分解,一种新型神经网络算子,在多个尺度上对通过类似Tucker分解的模式乘积得到的张量进行求和。与现有张量分解方法不同,MTS不用于网络压缩,而是作为新的核心网络层。它不仅显著减少参数量并提升优化效率,还优于传统密集层和卷积层。概念验证实验表明,MTS网络在分类、压缩和信号恢复等任务中表现优异。结合本文提出的多头门控(MHG)非线性单元后,所构建的MTSNet在多个视觉任务中展现出比先进Transformer更优的复杂度-性能权衡。相关代码已在https://github.com/mehmetyamac/MTSNet公开。

原文摘要 · Abstract (English)

Multilayer perceptrons (MLP), or fully connected artificial neural networks, are known for performing vector-matrix multiplications using learnable weight matrices; however, their practical application in many machine learning tasks, especially in computer vision, can be limited due to the high dimensionality of input-output pairs at each layer. To improve efficiency, convolutional operators have been utilized to facilitate weight sharing and local connections, yet they are constrained by limited receptive fields. In this paper, we introduce Multiscale Tensor Summation (MTS) Factorization, a novel neural network operator that implements tensor summation at multiple scales, where each tensor to be summed is obtained through Tucker-decomposition-like mode products. Unlike other tensor decomposition methods in the literature, MTS is not introduced as a network compression tool; instead, as a new backbone neural layer. MTS not only reduces the number of parameters required while enhancing the efficiency of weight optimization compared to traditional dense layers (i.e., unfactorized weight matrices in MLP layers), but it also demonstrates clear advantages over convolutional layers. The proof-of-concept experimental comparison of the proposed MTS networks with MLPs and Convolutional Neural Networks (CNNs) demonstrates their effectiveness across various tasks, such as classification, compression, and signal restoration. Additionally, when integrated with modern non-linear units such as the multi-head gate (MHG), also introduced in this study, the corresponding neural network, MTSNet, demonstrates a more favorable complexity-performance tradeoff compared to state-of-the-art transformers in various computer vision applications. The software implementation of the MTS layer and the corresponding MTS-based networks, MTSNets, is shared at https://github.com/mehmetyamac/MTSNet.

张量分解神经网络层计算机视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。