用变分条件模型模拟听力损失对听觉中脑神经编码的影响。
Modelling the Effects of Hearing Loss on Neural Coding in the Auditory Midbrain with Variational Conditioning
- 通过6个参数建模个体听力损失,从神经记录中学习听觉异常空间。
- 对正常与受损动物的神经响应预测分别解释62%和68%可解释方差。
- 仅需贝叶斯优化微调参数即可生成新个体真实神经活动,适合个性化听力补偿。
听觉的声信号到神经活动的映射具有高度非线性。耳蜗前几阶段的映射已通过生物物理模型或训练于生物物理模拟数据的深度神经网络(DNN)成功建模。然而,由于中枢听觉处理过于复杂,难以手工构建模型,且缺乏直接用于训练DNN的数据集,听觉脑部建模一直面临挑战。近期研究利用听觉中脑的大规模高分辨率神经记录,成功构建了正常听觉的DNN模型。但该模型假设所有大脑的听觉处理相同,无法捕捉听力损失的广泛差异。本文提出一种新型变分-条件模型,直接从健康及噪声暴露动物的听觉中脑神经记录中学习听力损失的空间表征。仅用每只动物6个自由参数参数化听力损失,模型对正常动物神经反应的可解释方差预测达62%,对受损动物达68%,与最先进的个体专用模型相差不到几个百分点。我们证明,通过贝叶斯优化仅拟合学习到的条件参数,即可在15–30次迭代内生成新个体的真实活动,交叉熵损失接近最优值的2%以内。增加训练动物数量略微提升了对未见动物的性能。该模型将推动未来可参数化的听力损失补偿模型发展,实现针对听觉受损大脑的神经编码恢复,并可通过人机协作优化快速适配新用户。
原文摘要 · Abstract (English)
The mapping from sound to neural activity that underlies hearing is highly non-linear. The first few stages of this mapping in the cochlea have been modelled successfully, with biophysical models built by hand and, more recently, with DNN models trained on datasets simulated by biophysical models. Modelling the auditory brain has been a challenge because central auditory processing is too complex for models to be built by hand, and datasets for training DNN models directly have not been available. Recent work has taken advantage of large-scale high resolution neural recordings from the auditory midbrain to build a DNN model of normal hearing with great success. But this model assumes that auditory processing is the same in all brains, and therefore it cannot capture the widely varying effects of hearing loss. We propose a novel variational-conditional model to learn to encode the space of hearing loss directly from recordings of neural activity in the auditory midbrain of healthy and noise exposed animals. With hearing loss parametrised by only 6 free parameters per animal, our model accurately predicts 62% of the explainable variance in neural responses from normal hearing animals and 68% for hearing impaired animals, within a few percentage points of state of the art animal specific models. We demonstrate that the model can be used to simulate realistic activity from out of sample animals by fitting only the learned conditioning parameters with Bayesian optimisation, achieving crossentropy loss within 2% of the optimum in 15-30 iterations. Including more animals in the training data slightly improved the performance on unseen animals. This model will enable future development of parametrised hearing loss compensation models trained to directly restore normal neural coding in hearing impaired brains, which can be quickly fitted for a new user by human in the loop optimisation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。