arXiv:2510.22383cs.LGcs.AI2025-10中稿 · presentation at th…

用生命游戏动态调控神经元,提升模型泛化能力

Dynamic Dropout: Leveraging Conway's Game of Life for Neural Networks Regularization

  • 将神经元视为生命游戏细胞,按规则动态激活/关闭
  • 在CIFAR-10上性能媲美传统dropout,且可生成可解释模式
  • 适合关注模型可解释性与深层网络正则化的研究者

正则化技术对防止过拟合并提升神经网络泛化能力至关重要。Dropout 是一种广泛应用的正则化方法,通过训练时随机关闭神经元单元来引入冗余并防止神经元间的共适应。尽管有效,Dropout 仍存在静态性和缺乏可解释性的局限。本文提出一种新正则化方法:用康威生命游戏(Conway's Game of Life, GoL)替代 Dropout。将神经网络单元表示为 GoL 网格中的细胞,依据其规则动态执行单元去激活。该方法能随训练数据自动生成空间模式,可能增强网络泛化能力。我们在 CIFAR-10 数据集上验证了该方法的有效性,结果显示基于 GoL 的动态单元去激活在性能上可媲美传统 Dropout,同时可通过可视化演化模式提供对网络行为的洞察。此外,我们的讨论还表明该方法适用于更深的网络结构,并能提升多种 Dropout 技术的表现。

原文摘要 · Abstract (English)

Regularization techniques play a crucial role in preventing overfitting and improving the generalization performance of neural networks. Dropout, a widely used regularization technique, randomly deactivates units during training to introduce redundancy and prevent co-adaptation among neurons. Despite its effectiveness, dropout has limitations, such as its static nature and lack of interpretability. In this paper, we propose a novel approach to regularization by substituting dropout with Conway's Game of Life (GoL), a cellular automata with simple rules that govern the evolution of a grid of cells. We introduce dynamic unit deactivation during training by representing neural network units as cells in a GoL grid and applying the game's rules to deactivate units. This approach allows for the emergence of spatial patterns that adapt to the training data, potentially enhancing the network's ability to generalize. We demonstrate the effectiveness of our approach on the CIFAR-10 dataset, showing that dynamic unit deactivation using GoL achieves comparable performance to traditional dropout techniques while offering insights into the network's behavior through the visualization of evolving patterns. Furthermore, our discussion highlights the applicability of our proposal in deeper architectures, demonstrating how it enhances the performance of different dropout techniques.

正则化生命游戏可解释性动态机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。