用强化学习模拟小鼠注意力策略,发现高效用脑需周期性切换专注与放松。
Attention when you need
- 构建基于强化学习的规范模型,模拟小鼠在任务中权衡注意力成本与收益。
- 发现高效注意力策略是周期性交替高/低注意力状态,而非持续专注。
- 适用于研究注意力机制、神经科学中的认知资源分配问题。
关注任务相关特征可提升表现,但注意力本身存在代谢代价。因此,战略性分配注意力对高效完成任务至关重要。本文研究该策略。近期,de Gee 等人让小鼠执行听觉持续注意力任务,需在噪声中识别高阶声学特征。通过调节试次时长和奖励大小,可探究代理如何策略性部署注意力以最大化收益并最小化成本。本文开发了一种基于强化学习的规范模型,模拟小鼠在每个时刻选择两种注意力水平,并决定何时采取代价高昂的动作以获取奖励。模型表明,高效使用注意力资源涉及高注意力与低注意力块的交替。在极端情况下,若低注意力状态下忽略感官输入,则高注意力呈周期性使用。该模型为如何根据任务效用、信号统计特性及注意力对感知证据的影响来部署注意力提供了实证支持。
原文摘要 · Abstract (English)
Being attentive to task-relevant features can improve task performance, but paying attention comes with its own metabolic cost. Therefore, strategic allocation of attention is crucial in performing the task efficiently. This work aims to understand this strategy. Recently, de Gee et al. conducted experiments involving mice performing an auditory sustained attention-value task. This task required the mice to exert attention to identify whether a high-order acoustic feature was present amid the noise. By varying the trial duration and reward magnitude, the task allows us to investigate how an agent should strategically deploy their attention to maximize their benefits and minimize their costs. In our work, we develop a reinforcement learning-based normative model of the mice to understand how it balances attention cost against its benefits. The model is such that at each moment the mice can choose between two levels of attention and decide when to take costly actions that could obtain rewards. Our model suggests that efficient use of attentional resources involves alternating blocks of high attention with blocks of low attention. In the extreme case where the agent disregards sensory input during low attention states, we see that high attention is used rhythmically. Our model provides evidence about how one should deploy attention as a function of task utility, signal statistics, and how attention affects sensory evidence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。