arXiv:2504.06881cs.CVcs.AI2025-04

用新型热带卷积提升模型效率,兼顾精度与计算成本

Compound and Parallel Modes of Tropical Convolutional Neural Networks

  • 引入复合与并行热带卷积,融合min/max+运算增强表达能力
  • 在图像分类与语义分割任务中性能接近标准CNN,乘法减少显著
  • 适合资源受限设备部署,尤其对低功耗视觉应用有实用价值

卷积神经网络(CNN)是当前计算机视觉系统的核心,但其依赖大量乘法运算,难以在资源受限设备上部署。热带卷积神经网络(TCNN)通过用更廉价的min/max+运算替代乘法来降低计算负担,但常以牺牲模型精度为代价。为此,本文提出两种新型热带卷积扩展:复合热带卷积(cTCNN)与并行热带卷积(pTCNN)。这些算子在同一层内结合min+与max+代数运算,增强表示能力的同时保持低计算开销。我们基于PyTorch实现了开源框架,并使用TileLang开发了优化的GPU核。在图像分类与语义分割基准上的大量实验表明,所提cTCNN与pTCNN层在保持显著减少乘法次数的前提下,性能可与标准CNN媲美。此外,混合模型(融合热带与传统卷积)进一步提升了精度-效率平衡。结果表明,这些热带卷积变体是构建高效深度学习模型的有效组件。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) are foundational to many state-of-the-art computer vision systems, yet their reliance on multiplication-intensive computations poses challenges for deployment on resource-constrained devices. While tropical convolutional neural networks (TCNNs) reduce this computational burden by replacing multiplications with cheaper min/maxplus operations, they often do so at the cost of reduced model accuracy. To address this tradeoff, we introduce two novel extensions of tropical convolution: compound tropical convolution (cTCNN) and parallel tropical convolution (pTCNN). These operators combine minplus and maxplus algebraic operations within a single layer to enhance representational capacity while maintaining low computational cost. We provide an open-source implementation of these operators in a PyTorch-compatible framework, featuring optimized GPU kernels developed with TileLang. Through extensive experiments on image classification and semantic segmentation benchmarks, we demonstrate that our proposed cTCNN and pTCNN layers achieve competitive performance against standard CNNs while significantly reducing the number of multiplications. Moreover, we show that hybrid models, which integrate both tropical and conventional convolutions, can further improve the accuracy-efficiency balance. Our findings suggest that these tropical convolution variants are viable and effective components for building efficient deep learning models

卷积网络热带计算轻量化模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。