arXiv:2501.12739cs.LG2025-01被引 4

通过多尺度梯度估计,训练高分辨率图像的CNN可提速4-16倍。

Multiscale Training of Convolutional Neural Networks

  • 用多尺度梯度求和替代单尺度计算,逐级粗化网格降低计算量。
  • 在去噪、去模糊等任务中,计算成本减少4-16倍,性能几乎不变。
  • 适合需要高效训练高分辨图像模型的研究者或工程应用。

在高分辨率图像上训练卷积神经网络(CNN)常受精细空间网格梯度计算成本限制。为此,我们提出多尺度梯度估计(MGE),一种受多水平蒙特卡洛启发的估计器,将最细网格上的期望梯度表示为逐步粗化的网格上梯度的望远镜求和。通过在更低成本的粗网格上分配更大批次,MGE 在保持与单尺度随机梯度估计相同方差的同时,使精细网格卷积次数每下采样一级减少4倍。我们进一步将MGE嵌入全多尺度训练算法,在粗网格上先求解学习问题,并“热启动”下一更细层级,额外减少约一个数量级的精细网格迭代次数。在使用UNet、ResNet和ESPCN主干网络的图像去噪、去模糊、修复和超分辨率任务上进行的大量实验验证了其有效性:全多尺度训练将计算成本降低4-16倍,且性能无显著下降。MGE与全多尺度共同提供了一条无需牺牲精度、适用于任意架构的高分辨率数据训练加速路径,可与其它方差缩减或学习率调度策略结合,进一步提升可扩展性。

原文摘要 · Abstract (English)

Training convolutional neural networks (CNNs) on high-resolution images is often bottlenecked by the cost of evaluating gradients of the loss on the finest spatial mesh. To address this, we propose Multiscale Gradient Estimation (MGE), a Multilevel Monte Carlo-inspired estimator that expresses the expected gradient on the finest mesh as a telescopic sum of gradients computed on progressively coarser meshes. By assigning larger batches to the cheaper coarse levels, MGE achieves the same variance as single-scale stochastic gradient estimation while reducing the number of fine mesh convolutions by a factor of 4 with each downsampling. We further embed MGE within a Full-Multiscale training algorithm that solves the learning problem on coarse meshes first and "hot-starts" the next finer level, cutting the required fine mesh iterations by an additional order of magnitude. Extensive experiments on image denoising, deblurring, inpainting and super-resolution tasks using UNet, ResNet and ESPCN backbones confirm the practical benefits: Full-Multiscale reduces the computation costs by 4-16x with no significant loss in performance. Together, MGE and Full-Multiscale offer a principled, architecture-agnostic route to accelerate CNN training on high-resolution data without sacrificing accuracy, and they can be combined with other variance-reduction or learning-rate schedules to further enhance scalability.

CNN训练多尺度加速图像恢复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。