提出双向预测编码模型,更贴近大脑实际的视觉推理机制。
Bidirectional predictive coding
- 构建兼具生成与判别推理的双向预测编码框架
- 在多模态学习和缺损信息推断任务中表现更优
- 保留生物可实现性,适用于复杂视觉任务
预测编码(PC)是解释大脑视觉学习与推理的重要计算模型。传统PC为自上而下的生成模型,大脑主动预测视觉输入并最小化预测误差;近年研究也发现其可作为自下而上的判别模型,感官输入驱动神经活动。然而实验表明大脑同时使用生成与判别推理,单向模型在需双向处理的任务中性能下降。本文提出双向预测编码(bPC),融合生成与判别推理,同时保持生物可实现的电路结构。bPC在各自擅长的生成或判别任务中表现匹配或超越单向模型,通过构建兼顾两者的能量景观实现。此外,在多模态学习和缺失信息推断等生物相关任务中,bPC表现出显著优势,表明其更贴近真实大脑的视觉推理机制。
原文摘要 · Abstract (English)
Predictive coding (PC) is an influential computational model of visual learning and inference in the brain. Classical PC was proposed as a top-down generative model, where the brain actively predicts upcoming visual inputs, and inference minimises the prediction errors. Recent studies have also shown that PC can be formulated as a discriminative model, where sensory inputs predict neural activities in a feedforward manner. However, experimental evidence suggests that the brain employs both generative and discriminative inference, while unidirectional PC models show degraded performance in tasks requiring bidirectional processing. In this work, we propose bidirectional PC (bPC), a PC model that incorporates both generative and discriminative inference while maintaining a biologically plausible circuit implementation. We show that bPC matches or outperforms unidirectional models in their specialised generative or discriminative tasks, by developing an energy landscape that simultaneously suits both tasks. We also demonstrate bPC's superior performance in two biologically relevant tasks including multimodal learning and inference with missing information, suggesting that bPC resembles biological visual inference more closely.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。