arXiv:2411.00983cs.LGcs.AI2024-11

在神经网络中验证注意力图式理论,提升智能体间协作与预测能力。

Testing Components of the Attention Schema Theory in Artificial Neural Networks

  • 引入注意力图式模型,使智能体更准确判断其他智能体的注意力状态。
  • 具备注意力图式的智能体其注意力模式更易被他人识别和分类。
  • 在协作绘画任务中,注意力图式显著提升合作效率,且效果专属于注意力相关任务。

越来越多证据表明,大脑使用注意力图式(一种注意力的简化模型)来调控注意力分配。该模型的一个可能优势是使智能体能够建模其他智能体的注意力状态,从而实现预测与交互。我们通过采用具有Transformer注意力机制的神经网络,在人工智能体中检验注意力图式的影响。结果表明:拥有注意力图式的智能体对其他智能体注意力状态的分类准确率更高;其自身的注意力模式也更易被其他智能体识别;在双智能体需相互预测以共同绘制场景的任务中,加入注意力图式可显著提升性能。这些改进并非源于网络复杂度的整体增加,而是特异性地作用于涉及判断、分类或预测他人注意力的任务。结果支持注意力图式具备促进互理解与互动行为的计算优势,推测其原理也可能适用于生物体的注意力及人类的注意力图式。

原文摘要 · Abstract (English)

Growing evidence suggests that the brain uses an attention schema, or a simplified model of attention, to help control what it attends to. One proposed benefit of this model is to allow agents to model the attention states of other agents, and thus predict and interact with other agents. The effects of an attention schema may be examined in artificial agents. Although attention mechanisms in artificial agents are different from in biological brains, there may be some principles in common. In both cases, select features or representations are emphasized for better performance. Here, using neural networks with transformer attention mechanisms, we asked whether the addition of an attention schema affected the ability of agents to make judgements about and cooperate with each other. First, we found that an agent with an attention schema is better at categorizing the attention states of other agents (higher accuracy). Second, an agent with an attention schema develops a pattern of attention that is easier for other agents to categorize. Third, in a joint task where two agents must predict each other to paint a scene together, adding an attention schema improves performance. Finally, the performance improvements are not caused by a general increase in network complexity. Instead, improvement is specific to tasks involving judging, categorizing, or predicting the attention of other agents. These results support the hypothesis that an attention schema has computational properties beneficial to mutual interpretability and interactive behavior. We speculate that the same principles might pertain to biological attention and attention schemas in people.

注意力机制智能体协作神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。