提出动态调制的混合反馈机制,提升预测编码网络对局部与全局信息的处理能力。
DMPCN: Dynamic Modulated Predictive Coding Network with Hybrid Feedback Representations
- 融合全局与局部误差反馈,动态调整模型响应复杂输入。
- 在多个数据集上实现更快收敛与更高预测精度。
- 适用于需要自适应建模的视觉任务,如图像重建与分类。
受大脑功能理论启发的传统预测编码网络在多个领域表现优异,尤其在计算机视觉中影响深远。然而,其性能受限于误差反馈机制:传统方法采用局部或全局循环更新,难以同时有效处理局部细节与整体结构。此外,这些网络在面对不同复杂度输入时缺乏动态调节能力,且缺乏针对性损失函数来引导模型优化。为此,本文提出一种结合全局上下文与局部细节的混合预测误差反馈机制,并引入动态调制策略以根据输入复杂度自适应调整反馈强度。同时,设计了一种专用于该框架的损失函数,聚焦于精确预测误差最小化,以提升模型准确性。实验表明,所提模型在CIFAR-10、CIFAR-100、MNIST和FashionMNIST等多个数据集上均优于现有方法,表现出更快收敛速度与更高预测精度。
原文摘要 · Abstract (English)
Traditional predictive coding networks, inspired by theories of brain function, consistently achieve promising results across various domains, extending their influence into the field of computer vision. However, the performance of the predictive coding networks is limited by their error feedback mechanism, which traditionally employs either local or global recurrent updates, leading to suboptimal performance in processing both local and broader details simultaneously. In addition, traditional predictive coding networks face difficulties in dynamically adjusting to the complexity and context of varying input data, which is crucial for achieving high levels of performance in diverse scenarios. Furthermore, there is a gap in the development and application of specific loss functions that could more effectively guide the model towards optimal performance. To deal with these issues, this paper introduces a hybrid prediction error feedback mechanism with dynamic modulation for deep predictive coding networks by effectively combining global contexts and local details while adjusting feedback based on input complexity. Additionally, we present a loss function tailored to this framework to improve accuracy by focusing on precise prediction error minimization. Experimental results demonstrate the superiority of our model over other approaches, showcasing faster convergence and higher predictive accuracy in CIFAR-10, CIFAR-100, MNIST, and FashionMNIST datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。