用博弈论和统计物理设计新神经网络,提升人脸识别精度与效率
Game Theory Meets Statistical Mechanics in Deep Learning Design
- 将神经元比作博弈玩家,层间传播视为序列合作博弈
- 通过谢林值评估贡献,仅允许高贡献神经元传递信息
- 在年龄与性别识别任务中优于MLP和CNN,兼具高效与准确
我们提出一种新型深度图表示方法,将博弈论与统计力学原理无缝融合。该框架统一实现特征提取、降维与模式分类。将网络中的神经元类比为博弈模型中的玩家,每个神经元被视作受统计物理定律约束的经典粒子,其激活值对应一组动作;各网络层被构想为序列合作博弈中的游戏阶段。前向传播过程被解释为一系列博弈,每轮包含一组玩家。训练时,依据能量函数驱动的谢林值量化神经元对收益函数的贡献,并迭代评估与筛选。显著贡献收益的神经元形成强联盟,仅这些神经元可将信息传递至下一层。该方法应用于面部年龄估计与性别分类任务,实验表明其在效率与准确性上均优于多层感知机与卷积神经网络模型。
原文摘要 · Abstract (English)
We present a novel deep graphical representation that seamlessly merges principles of game theory with laws of statistical mechanics. It performs feature extraction, dimensionality reduction, and pattern classification within a single learning framework. Our approach draws an analogy between neurons in a network and players in a game theory model. Furthermore, each neuron viewed as a classical particle (subject to statistical physics' laws) is mapped to a set of actions representing specific activation value, and neural network layers are conceptualized as games in a sequential cooperative game theory setting. The feed-forward process in deep learning is interpreted as a sequential game, where each game comprises a set of players. During training, neurons are iteratively evaluated and filtered based on their contributions to a payoff function, which is quantified using the Shapley value driven by an energy function. Each set of neurons that significantly contributes to the payoff function forms a strong coalition. These neurons are the only ones permitted to propagate the information forward to the next layers. We applied this methodology to the task of facial age estimation and gender classification. Experimental results demonstrate that our approach outperforms both multi-layer perceptron and convolutional neural network models in terms of efficiency and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。