混合推理方法让深层稀疏预测编码更快更准。
Accelerating Hierarchical Sparse Predictive Coding with Hybrid Amortized Inference
- 用快速初始化加少量修正步骤替代反复迭代
- 重建质量更高,延迟降低60%以上
- 适合需要高速低延迟的神经形态计算场景
层次化预测编码为感知提供了可解释的误差驱动推断框架,而稀疏编码通过显式稀疏性约束实现简洁的潜在表示。两者的结合形成具有优异计算与神经科学特性的层次稀疏预测编码模型,但实际应用常受限于潜在变量推断的高成本。在该类模型中,每个输入可能需多次循环精炼才能获得有效稀疏表示,且随着层级加深,负担愈发严重。本文比较了采用相同层次稀疏目标与架构、但使用不同潜在变量推断机制的训练-推断流程:基于ISTA的经典迭代推断、加速版MFISTA参考方法、基于LISTA风格自底向上编码器的结构感知摊销推断,以及将快速摊销初始化与少量基于能量的修正步骤相结合的混合方法。各方法独立训练,使其推断机制能与字典学习及编码器学习交互。在静态图像基准上评估重建质量、稀疏性、延迟和随机种子间的运行变异性。结果表明,混合方法在测试设置下优于纯摊销,同时显著快于长迭代推断方法。
原文摘要 · Abstract (English)
Hierarchical predictive coding provides an interpretable framework for perception as error-driven inference in multi-layer models, while sparse coding imposes parsimonious latent representations through explicit sparsity constraints. Their combination yields hierarchical sparse predictive coding models with appealing computational and neuroscientific properties, but practical use is often limited by the cost of iterative latent inference. In such models, each input may require many recurrent refinement steps before a useful sparse representation is obtained, and this burden becomes more severe as the hierarchy deepens. We study this bottleneck by comparing training-and-inference procedures that share the same hierarchical sparse objective formulation and architecture but use different latent-inference mechanisms. The comparison includes classical iterative inference based on ISTA, an accelerated MFISTA reference, structurally informed amortized inference using a LISTA-style bottom-up encoder adapted to the hierarchical model, and a Hybrid procedure in which this fast amortized initialization is followed by a small number of corrective energy-based refinement steps. Each procedure is trained separately, allowing its inference mechanism to interact with dictionary learning and, where applicable, encoder learning. We measure the resulting reconstruction quality, sparsity, latency, and run-to-run variability across random seeds on static image benchmarks. The results show that Hybrid improves over pure amortization in the tested settings while remaining substantially faster than procedures based on long iterative inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。