用神经同步机制解决视觉特征绑定问题,提升模型抗噪与泛化能力。
GASPnet: Global Agreement to Synchronize Phases
- 在卷积网络中引入相位同步,通过柯尔莫哥洛夫动力学对齐相位
- 在相位一致的神经元间增强连接,相反相位则抑制,提升特征整合
- 在数字配对和混合图像任务中优于传统CNN,尤其抗噪声表现更优
近年来,Transformer架构凭借基于键与查询之间一致性的注意力机制,革新了人工智能多个领域。此前我们提出一种受大脑启发的新型架构,通过全局查询与各神经元键的匹配实现‘按共识路由’,该机制虽提升了抗噪性能,但难以胜任多分类任务。本文进一步提出一种新机制,融合Transformer注意力与神经科学中的‘同步绑定’理论——即通过神经元活动的时序同步来关联同一物体的特征,同时区分不同物体的特征。我们将在全层卷积网络中引入相位,并利用柯尔莫哥洛夫动力学实现相位对齐,进而强化同相位神经元间的交互,抑制反相位交互。在两个数据集上测试:一对数字组成的图像,以及将MNIST图像叠加在CIFAR-10图像上的复合图像。结果表明,该方法在准确率、抗噪性与泛化能力方面均优于标准CNN,验证了其在视觉绑定问题上的有效性。整体而言,该工作通过神经科学与机器学习的协同,提出了一种新颖的视觉特征绑定机制。
原文摘要 · Abstract (English)
In recent years, Transformer architectures have revolutionized most fields of artificial intelligence, relying on an attentional mechanism based on the agreement between keys and queries to select and route information in the network. In previous work, we introduced a novel, brain-inspired architecture that leverages a similar implementation to achieve a global 'routing by agreement' mechanism. Such a system modulates the network's activity by matching each neuron's key with a single global query, pooled across the entire network. Acting as a global attentional system, this mechanism improves noise robustness over baseline levels but is insufficient for multi-classification tasks. Here, we improve on this work by proposing a novel mechanism that combines aspects of the Transformer attentional operations with a compelling neuroscience theory, namely, binding by synchrony. This theory proposes that the brain binds together features by synchronizing the temporal activity of neurons encoding those features. This allows the binding of features from the same object while efficiently disentangling those from distinct objects. We drew inspiration from this theory and incorporated angular phases into all layers of a convolutional network. After achieving phase alignment via Kuramoto dynamics, we use this approach to enhance operations between neurons with similar phases and suppresses those with opposite phases. We test the benefits of this mechanism on two datasets: one composed of pairs of digits and one composed of a combination of an MNIST item superimposed on a CIFAR-10 image. Our results reveal better accuracy than CNN networks, proving more robust to noise and with better generalization abilities. Overall, we propose a novel mechanism that addresses the visual binding problem in neural networks by leveraging the synergy between neuroscience and machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。