arXiv:2502.20493cs.LGcs.AI2025-02

提出统一核分割方法,提升反卷积运算速度与内存效率。

Unified Kernel-Segregated Transpose Convolution Operation

  • 用一个统一核执行四个子核,减少资源占用
  • 在RTX 2070上平均提速2.03倍,最高达3.89倍
  • 适合生成模型中的反卷积层优化,尤其适用于GANS

为优化深度学习中反卷积层的性能,本文引入统一核分割方法,通过一个统一核执行四个子核,降低内存和计算资源消耗。实验表明,在RTX 2070 GPU上,该方法在特定数据集测试中平均实现2.03倍(最高3.89倍)的计算加速;在主流生成对抗网络(GANs)的反卷积层评估中,平均加速达3.5倍。在EB-GAN模型中应用该方法,反卷积层内存使用最多可节省35 MB。

原文摘要 · Abstract (English)

The optimization of the transpose convolution layer for deep learning applications is achieved with the kernel segregation mechanism. However, kernel segregation has disadvantages, such as computing extra elements to obtain the output feature map with odd dimensions while launching a thread. To mitigate this problem, we introduce a unified kernel segregation approach that limits the usage of memory and computational resources by employing one unified kernel to execute four sub-kernels. The findings reveal that the suggested approach achieves an average computational speedup of 2.03x (3.89x) when tested on specific datasets with an RTX 2070 GPU (Intel Xeon CPU). The ablation study shows an average computational speedup of 3.5x when evaluating the transpose convolution layers from well-known Generative Adversarial Networks (GANs). The implementation of the proposed method for the transpose convolution layers in the EB-GAN model demonstrates significant memory savings of up to 35 MB.

反卷积GPU优化生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。