研究自然物体在记忆中的神经表征,发现模型用时间分层空间保持信息。
Geometry of naturalistic object representations in recurrent neural network models of working memory

- 用CNN-RNN模型在九个N-back任务中训练,使用真实物体刺激
- 不同任务共享编码变换,但干扰下保留记忆的机制各不相同
- 模型将物体嵌入非正交新空间,适合研究人类工作记忆神经机制
工作记忆是智能决策的核心认知能力。以往研究多采用类别化(如独热编码)输入,且局限于单一或少数任务。本研究构建了包含卷积神经网络(CNN)与循环神经网络(RNN)的感官-认知模型,使用自然物体刺激,在九个N-back任务中进行训练。分析RNN隐状态空间发现:(1) 多任务RNN同时表征任务相关与无关信息;(2) 基础RNN中特定物体属性的隐空间在任务间高度共享,而门控RNN(如GRU、LSTM)则具有高度任务特异性;(3) 令人意外的是,RNN将物体嵌入新表示空间,其中各特征间正交性低于感知空间;(4) 工作记忆编码(即视觉输入嵌入隐空间)的转换在不同刺激间共享,但面对干扰时维持记忆的转换机制随时间变化而不同。结果表明,目标驱动的RNN利用时间顺序的子空间追踪短期信息,可产生可检验的神经预测。
原文摘要 · Abstract (English)
Working memory is a central cognitive ability crucial for intelligent decision-making. Recent experimental and computational work studying working memory has primarily used categorical (i.e., one-hot) inputs, rather than ecologically relevant, multidimensional naturalistic ones. Moreover, studies have primarily investigated working memory during single or few cognitive tasks. As a result, an understanding of how naturalistic object information is maintained in working memory in neural networks is still lacking. To bridge this gap, we developed sensory-cognitive models, comprising a convolutional neural network (CNN) coupled with a recurrent neural network (RNN), and trained them on nine distinct N-back tasks using naturalistic stimuli. By examining the RNN's latent space, we found that: (1) Multi-task RNNs represent both task-relevant and irrelevant information simultaneously while performing tasks; (2) The latent subspaces used to maintain specific object properties in vanilla RNNs are largely shared across tasks, but highly task-specific in gated RNNs such as GRU and LSTM; (3) Surprisingly, RNNs embed objects in new representational spaces in which individual object features are less orthogonalized relative to the perceptual space; (4) The transformation of working memory encodings (i.e., embedding of visual inputs in the RNN latent space) into memory was shared across stimuli, yet the transformations governing the retention of a memory in the face of incoming distractor stimuli were distinct across time. Our findings indicate that goal-driven RNNs employ chronological memory subspaces to track information over short time spans, enabling testable predictions with neural data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。