arXiv:2604.08072cs.CVphysics.comp-ph2026-04

用张量核替代传统卷积核,让浅层网络也能高效捕捉复杂特征关联。

Tensor-Augmented Convolutional Neural Networks: Enhancing Expressivity with Generic Tensor Kernels

  • 用通用张量替换卷积核,提升模型表达能力
  • 两层TACNN在Fashion-MNIST上达93.7%准确率
  • 适合追求高效可解释模型的研究者

卷积神经网络(CNN)擅长层次化提取局部特征,但捕捉复杂相关性依赖深层结构,通常计算开销大且难解释。为此,我们提出物理启发的浅层模型:张量增强卷积神经网络(TACNN),将传统卷积核替换为通用张量以增强表征能力。这一设计基于高阶张量在维度为 $d^N$ 的希尔伯特空间中自然编码任意量子叠加态的性质,从而显著提升表达力。此外,每层卷积输出变为多线性形式,可捕获高阶特征关联,使浅层多层架构具备与深层CNN相当的表达能力。在Fashion-MNIST基准上,TACNN表现优异:仅两层卷积即达93.7%测试准确率,超越或媲美更深层的VGG-16(93.5%)和GoogLeNet(93.7%)。结果表明,TACNN是一种兼具高表达力与架构简洁性的有前景框架,有助于构建更高效、可解释的深度学习模型。

原文摘要 · Abstract (English)

Convolutional Neural Networks (CNNs) excel at extracting local features hierarchically, but their performance in capturing complex correlations hinges heavily on deep architectures, which are usually computationally demanding and difficult to interpret. To address these issues, we propose a physically-guided shallow model: tensor-augmented CNN (TACNN), which replaces conventional convolution kernels with generic tensors to enhance representational capacity. This choice is motivated by the fact that an order-$N$ tensor naturally encodes an arbitrary quantum superposition state in the Hilbert space of dimension $d^N$, where $d$ is the local physical dimension, thus offering substantially richer expressivity. Furthermore, in our design the convolution output of each layer becomes a multilinear form capable of capturing high-order feature correlations, thereby equipping a shallow multilayer architecture with an expressive power competitive to that of deep CNNs. On the Fashion-MNIST benchmark, TACNN demonstrates clear advantages over conventional CNNs, achieving remarkable accuracies with only a few layers. In particular, a TACNN with only two convolution layers attains a test accuracy of 93.7$\%$, surpassing or matching considerably deeper models such as VGG-16 (93.5$\%$) and GoogLeNet (93.7$\%$). These findings highlight TACNN as a promising framework that strengthens model expressivity while preserving architectural simplicity, paving the way towards more interpretable and efficient deep learning models.

卷积网络张量建模浅层网络表达力增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。