arXiv:2507.16279cs.CV2025-07TPAMI被引 7

提出MAN++,让视觉任务训练更高效且省显存。

MAN++: Scaling Momentum Auxiliary Network for Supervised Local Learning in Vision Tasks

  • 用动态参数交互机制替代传统反向传播,分块独立更新。
  • 在多个任务上达到与端到端训练相当的精度,显存降低显著。
  • 适合追求低资源训练或生物可解释性的研究者使用。

深度学习通常依赖端到端反向传播训练,存在参数更新锁定、高显存占用及缺乏生物合理性等问题。相比之下,监督局部学习将网络划分为多个局部模块,并设计独立辅助网络分别更新每个模块,但因梯度仅在模块内传播,导致性能下降。为此,本文提出动量辅助网络++(MAN++),通过相邻模块参数的指数移动平均(EMA)实现动态交互,增强模块间信息流动。为解决不同模块间特征差异带来的性能损失,引入可学习缩放偏置以平衡特征差异。大量实验表明,MAN++在图像分类、目标检测和图像分割任务中,采用多种网络结构,表现接近端到端训练,同时显著降低显存消耗。该方法为监督局部学习提供了新思路,是传统训练方法的有效替代方案。

原文摘要 · Abstract (English)

Deep learning typically relies on end-to-end backpropagation for training, a method that inherently suffers from issues such as update locking during parameter optimization, high GPU memory consumption, and a lack of biological plausibility. In contrast, supervised local learning seeks to mitigate these challenges by partitioning the network into multiple local blocks and designing independent auxiliary networks to update each block separately. However, because gradients are propagated solely within individual local blocks, performance degradation occurs, preventing supervised local learning from supplanting end-to-end backpropagation. To address these limitations and facilitate inter-block information flow, we propose the Momentum Auxiliary Network++ (MAN++). MAN++ introduces a dynamic interaction mechanism by employing the Exponential Moving Average (EMA) of parameters from adjacent blocks to enhance communication across the network. The auxiliary network, updated via EMA, effectively bridges the information gap between blocks. Notably, we observed that directly applying EMA parameters can be suboptimal due to feature discrepancies between local blocks. To resolve this issue, we introduce a learnable scaling bias that balances feature differences, thereby further improving performance. We validate MAN++ through extensive experiments on tasks that include image classification, object detection, and image segmentation, utilizing multiple network architectures. The experimental results demonstrate that MAN++ achieves performance comparable to end-to-end training while significantly reducing GPU memory usage. Consequently, MAN++ offers a novel perspective for supervised local learning and presents a viable alternative to conventional training methods.

视觉任务低显存训练分块学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。