arXiv:2409.17282cs.LGcs.AI2024-09

提出无需反向传播的单次前向记忆网络,更贴近大脑学习机制。

Memory Networks: Towards Fully Biologically Plausible Learning

  • 基于生物原理设计,无反向传播和卷积,仅单次前向计算
  • 在MNIST上表现良好,支持快速少量数据学习
  • 适合研究生物可解释性神经网络的人参考

人工智能领域在实现生物可解释性与计算效率方面面临重大挑战,尤其在视觉学习任务中。当前的人工神经网络(如卷积神经网络)依赖反向传播和权值共享,与大脑自然的信息处理方式不一致。为此,我们提出记忆网络(Memory Network),一种受生物学原理启发的模型,避免使用反向传播和卷积,采用单次前向运行。该方法实现了快速高效的學習,模拟了大脑在极少数据暴露下快速适应的能力。实验表明,记忆网络在简单数据集(如MNIST)上表现优异,展现出高效且生物可解释的学习能力。然而,对于更复杂的数据集(如CIFAR10),仍需进一步改进,说明未来需开发更贴近生物过程且保持计算效率的新算法与技术。

原文摘要 · Abstract (English)

The field of artificial intelligence faces significant challenges in achieving both biological plausibility and computational efficiency, particularly in visual learning tasks. Current artificial neural networks, such as convolutional neural networks, rely on techniques like backpropagation and weight sharing, which do not align with the brain's natural information processing methods. To address these issues, we propose the Memory Network, a model inspired by biological principles that avoids backpropagation and convolutions, and operates in a single pass. This approach enables rapid and efficient learning, mimicking the brain's ability to adapt quickly with minimal exposure to data. Our experiments demonstrate that the Memory Network achieves efficient and biologically plausible learning, showing strong performance on simpler datasets like MNIST. However, further refinement is needed for the model to handle more complex datasets such as CIFAR10, highlighting the need to develop new algorithms and techniques that closely align with biological processes while maintaining computational efficiency.

记忆网络生物可解释单次学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。