arXiv:2509.23103cs.CVcs.AI2025-09

用哈达玛变换和存内计算,让神经网络少算52%乘法,还能保持精度。

HTMA-Net: Towards Multiplication-Avoiding Neural Networks via Hadamard Transform and In-Memory Computing

  • 用哈达玛变换替代部分卷积,结合存内计算避免乘法
  • 在多个数据集上减少52%乘法,参数量和计算量大幅下降
  • 适合部署在低功耗边缘设备的高效神经网络设计

降低乘法运算成本对高效部署深度神经网络至关重要,尤其在功耗受限的边缘设备上。本文提出HTMA-Net,一种将哈达玛变换(HT)与基于SRAM的乘法避免型存内计算相结合的新框架,在保持精度的同时降低算术复杂度。与仅针对卷积层乘法或仅关注存内加速的先前方法不同,HTMA-Net选择性地将中间卷积替换为基于混合哈达玛变换的层,其内部卷积通过乘法避免的存内操作实现。我们在ResNet-18上使用CIFAR-10、CIFAR-100和Tiny ImageNet进行评估,并与标准模型、仅含乘法避免(MF-only)和仅含哈达玛变换(HT-only)的变体进行对比。结果表明,相较于基线的ResNet-18、ResNet-20和ResNet-32模型,HTMA-Net最多可减少52%的乘法运算,同时保持相当的准确率,显著降低计算复杂度和参数数量。实验表明,将结构化哈达玛变换层与基于SRAM的乘法避免存内计算操作结合,是构建高效深度学习架构的有前景路径。

原文摘要 · Abstract (English)

Reducing the cost of multiplications is critical for efficient deep neural network deployment, especially in energy-constrained edge devices. In this work, we introduce HTMA-Net, a novel framework that integrates the Hadamard Transform (HT) with multiplication-avoiding (MA) SRAM-based in-memory computing to reduce arithmetic complexity while maintaining accuracy. Unlike prior methods that only target multiplications in convolutional layers or focus solely on in-memory acceleration, HTMA-Net selectively replaces intermediate convolutions with Hybrid Hadamard-based transform layers whose internal convolutions are implemented via multiplication-avoiding in-memory operations. We evaluate HTMA-Net on ResNet-18 using CIFAR-10, CIFAR-100, and Tiny ImageNet, and provide a detailed comparison against regular, MF-only, and HT-only variants. Results show that HTMA-Net eliminates up to 52\% of multiplications compared to baseline ResNet-18, ResNet-20, and ResNet-32 models, while achieving comparable accuracy in evaluation and significantly reducing computational complexity and the number of parameters. Our results demonstrate that combining structured Hadamard transform layers with SRAM-based in-memory computing multiplication-avoiding operators is a promising path towards efficient deep learning architectures.

神经网络优化存内计算哈达玛变换边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。