arXiv:2509.12394cs.LG2025-09中稿 · 2026 IEEE Internat…被引 2

提出ASGE框架,让前向-前向学习在无反向传播下实现高效训练并突破大规模图像识别瓶颈。

Adaptive Spatial Goodness Encoding: Advancing and Scaling Forward-Forward Learning Without Backpropagation

  • 用特征图生成空间感知的良度表示,实现逐层监督
  • 在多个数据集上达到媲美反向传播的精度,最高达99.65%
  • 首次成功应用于ImageNet,适合资源受限场景的灵活部署

前向-前向(FF)算法为反向传播(BP)提供了有前景的替代方案。尽管近期的FF扩展已提升原始算法并适配卷积神经网络(CNN),但通常受限于表征能力弱和难以扩展至大规模数据集,主要源于通道维度爆炸问题。本文提出自适应空间良度编码(ASGE),一种专为CNN设计的新型FF训练框架。ASGE利用特征图在每一层计算空间感知的良度表示,实现逐层监督。关键在于,该方法将分类复杂度与通道维度解耦,有效缓解通道爆炸问题,并取得与其它BP替代方案相当的性能。ASGE在多个基准测试中超越所有其他基于FF的方法:在MNIST上达到99.65%准确率,FashionMNIST为93.41%,CIFAR-10为90.62%,CIFAR-100为65.42%。此外,我们首次成功将基于FF的训练应用于ImageNet,Top-1和Top-5准确率分别达到51.58%和75.23%。同时提出三种预测策略,可在精度、参数量和内存使用间灵活权衡,适用于不同资源约束下的部署。

原文摘要 · Abstract (English)

The Forward-Forward (FF) algorithm offers a promising alternative to backpropagation (BP). Despite advancements in recent FF-based extensions, which have enhanced the original algorithm and adapted it to convolutional neural networks (CNNs), they often suffer from limited representational capacity and poor scalability to large-scale datasets, primarily due to exploding channel dimensionality. In this work, we propose adaptive spatial goodness encoding (ASGE), a new FF-based training framework tailored for CNNs. ASGE leverages feature maps to compute spatially-aware goodness representations at each layer, enabling layer-wise supervision. Crucially, this approach decouples classification complexity from channel dimensionality, thereby addressing the issue of channel explosion and achieving competitive performance compared to other BP alternatives. ASGE outperforms all other FF-based approaches across multiple benchmarks, delivering test accuracies of 99.65% on MNIST, 93.41% on FashionMNIST, 90.62% on CIFAR-10, and 65.42% on CIFAR-100. Moreover, we present the first successful application of FF-based training to ImageNet, with Top-1 and Top-5 accuracies of 51.58% and 75.23%. Furthermore, we propose three prediction strategies to achieve flexible trade-offs among accuracy, parameters and memory usage, enabling deployment under diverse resource constraints.

前向学习无反向传播卷积网络图像识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。