arXiv:2602.13421stat.MLcs.AI2026-02被引 1

用泊松分布建模神经活动,让信息处理能耗可量化

Metabolic cost of information processing in Poisson variational autoencoders

  • 基于泊松分布的变分自编码器,将神经元发放率自然纳入能量成本
  • 调节KL项权重可单调提升稀疏性并降低平均放电率
  • 适合研究脑启发计算与低能耗人工智能的科研人员

生物系统中的计算本质是能量受限的,但传统计算理论将能量视为无限可用。本文提出,在泊松假设下进行变分自由能最小化,可构建能量感知的计算理论。关键发现是:泊松自由能目标函数中的KL散度项与模型神经元先验发放率成正比,从而产生一个涌现的代谢成本项,惩罚高基线活动。这一结构将抽象的信息论量——编码率——与具体的生物物理变量——发放率——耦合,实现编码保真度与能耗之间的权衡。这种耦合在泊松变分自编码器(P-VAE)中自然出现——这是一种受大脑启发的生成模型,将输入编码为离散脉冲计数,并以稀疏编码为特例——而在标准高斯变分自编码器(Gaussian VAE)中不存在。为验证该代谢成本结构的唯一性,我们对比了P-VAE与采用ReLU修正的高斯变分自编码器(Grelu-VAE),后者控制了非负性约束。在系统扫描不同KL项权重系数β和隐层维度下,发现增大β会单调增加稀疏性并降低平均脉冲活动,而Grelu-VAE表示保持不变,证实该效应仅源于泊松统计而非非负表示的副产物。这些结果确立泊松变分推断作为资源受限计算理论的有力基础。

原文摘要 · Abstract (English)

Computation in biological systems is fundamentally energy-constrained, yet standard theories of computation treat energy as freely available. Here, we argue that variational free energy minimization under a Poisson assumption offers a principled path toward an energy-aware theory of computation. Our key observation is that the Kullback-Leibler (KL) divergence term in the Poisson free energy objective becomes proportional to the prior firing rates of model neurons, yielding an emergent metabolic cost term that penalizes high baseline activity. This structure couples an abstract information-theoretic quantity -- the *coding rate* -- to a concrete biophysical variable -- the *firing rate* -- which enables a trade-off between coding fidelity and energy expenditure. Such a coupling arises naturally in the Poisson variational autoencoder (P-VAE) -- a brain-inspired generative model that encodes inputs as discrete spike counts and recovers a spiking form of *sparse coding* as a special case -- but is absent from standard Gaussian VAEs. To demonstrate that this metabolic cost structure is unique to the Poisson formulation, we compare the P-VAE against Grelu-VAE, a Gaussian VAE with ReLU rectification applied to latent samples, which controls for the non-negativity constraint. Across a systematic sweep of the KL term weighting coefficient $β$ and latent dimensionality, we find that increasing $β$ monotonically increases sparsity and reduces average spiking activity in the P-VAE. In contrast, Grelu-VAE representations remain unchanged, confirming that the effect is specific to Poisson statistics rather than a byproduct of non-negative representations. These results establish Poisson variational inference as a promising foundation for a resource-constrained theory of computation.

神经计算能量效率变分推断稀疏编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。