用神经翻译模型解释人类记忆搜索的机制,发现其与认知模型高度吻合。
Sequence-to-Sequence Models with Attention Mechanistically Map to the Architecture of Human Memory Search
- 用带注意力的RNN序列模型模拟人类记忆搜索过程
- 模型能同时匹配平均和最优的人类行为模式
- 为记忆研究提供可解释的新建模工具,适合认知科学与AI交叉研究
以往研究已认识到上下文在引导人类记忆搜索中的关键作用。尽管基于上下文的记忆模型能解释多种记忆现象,但为何人类会演化出此类架构仍不明确。本文证明,神经机器翻译中的基础架构——尤其是带注意力的循环神经网络(RNN)序列到序列模型——其内部机制与人类记忆的上下文维持与检索(CMR)模型直接对应。由于这些神经翻译模型在任务性能优化中自然演化,其与人类记忆模型的收敛,揭示了上下文在人类记忆中的功能意义,并为建模人类记忆提供了新路径。我们据此构建了一个可解释的神经翻译模型作为人类记忆搜索的认知模型,该模型能有效捕捉复杂学习动态。实验表明,该模型在拟合人类平均行为和最优行为方面均达到现有上下文记忆模型的水平。进一步分析显示,不同模型组件间的交互可自然产生记忆搜索性能,凸显其内在机制优势。
原文摘要 · Abstract (English)
Past work has long recognized the important role of context in guiding how humans search their memory. While context-based memory models can explain many memory phenomena, it remains unclear why humans develop such architectures over possible alternatives in the first place. In this work, we demonstrate that foundational architectures in neural machine translation -- specifically, recurrent neural network (RNN)-based sequence-to-sequence models with attention -- exhibit mechanisms that directly correspond to those specified in the Context Maintenance and Retrieval (CMR) model of human memory. Since neural machine translation models have evolved to optimize task performance, their convergence with human memory models provides a deeper understanding of the functional role of context in human memory, as well as presenting new ways to model human memory. Leveraging this convergence, we implement a neural machine translation model as a cognitive model of human memory search that is both interpretable and capable of capturing complex dynamics of learning. We show that our model accounts for both averaged and optimal human behavioral patterns as effectively as context-based memory models. Further, we demonstrate additional strengths of the proposed model by evaluating how memory search performance emerges from the interaction of different model components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。