用扩散模型分析大脑如何通过不确定性预测来学习,解释神经反馈表现差异。
Characterizing higher-order representations through generative diffusion models explains human decoded neurofeedback performance
- 用强化学习训练扩散模型,从脑成像数据中推断噪声分布。
- 模型能更好复现人类在神经反馈任务中的表现,且与个体成功度相关。
- 揭示了人脑对自身认知不确定性的高阶表征,适合研究认知机制者阅读。
大脑不仅构建环境的‘一阶’表征,还形成关于这些表征的‘高阶’表征——包括表征不确定性的估计,指导学习与适应性行为。关于表征不确定性的高阶预期(通过经验习得)可能在行为和学习中起关键作用,但其表征在实证和理论上仍具挑战。本文提出噪声估计通过强化学习驱动的扩散模型(NERD),一种新计算框架,通过强化学习训练去噪扩散模型,以推断功能性MRI数据中的噪声分布,来自一项人类参与者学习达成目标神经状态的解码神经反馈任务。我们假设参与者通过学习并最小化自身的表征不确定性完成任务。利用NERD验证该假设,其模仿大脑类无监督学习。结果表明,相较于反向传播训练的对照模型,NERD在捕捉人类表现方面表现更优,且通过聚类学习到的噪声分布提升了解释力。更重要的是,结果揭示了个体内预期不确定性表征的差异,可预测任务成功率,证明NERD是探测高阶神经表征的强大工具。
原文摘要 · Abstract (English)
Brains construct not only "first-order" representations of the environment but also "higher-order" representations about those representations -- including higher-order uncertainty estimates that guide learning and adaptive behavior. Higher-order expectations about representational uncertainty -- i.e., learned through experience -- may play a key role in guiding behavior and learning, but their characterization remains empirically and theoretically challenging. Here, we introduce the Noise Estimation through Reinforcement-based Diffusion (NERD) model, a novel computational framework that trains denoising diffusion models via reinforcement learning to infer distributions of noise in functional MRI data from a decoded neurofeedback task, where healthy human participants learn to achieve target neural states. We hypothesize that participants accomplish this task by learning about and then minimizing their own representational uncertainty. We test this hypothesis with NERD, which mirrors brain-like unsupervised learning. Our results show that NERD outperforms backpropagation-trained control models in capturing human performance with explanatory power enhanced by clustering learned noise distributions. Importantly, our results also reveal individual differences in expected-uncertainty representations that predict task success, demonstrating NERD's utility as a powerful tool for probing higher-order neural representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。