arXiv:2512.11415cond-mat.stat-mechcs.LG2025-12中稿 · PRE

让隐变量产生非平衡循环,提升生成模型精度。

Emergence of Nonequilibrium Latent Cycles in Unsupervised Generative Modeling

  • 用两个独立参数转移矩阵构建非平衡马尔可夫链
  • 训练后隐空间出现持续概率流,熵产率与数据拟合度正相关
  • 适合研究生成模型与统计物理交叉的学者

我们证明,非平衡动力学在无监督机器学习中可发挥建设性作用,能自发诱导隐状态循环。提出一种模型,其中可观测变量与隐变量通过两个独立参数化的转移矩阵交互,构成稳态本就非平衡的马尔可夫链。似然最大化促使系统趋向具有有限熵产、自转移概率降低、隐空间存在持续概率流的非平衡稳态。这些循环并非由架构强制引入,而是训练过程中自发产生;能更准确复现数据类的分布,且与数据一致性与熵产率呈明显正相关。相比受限玻尔兹曼机等平衡方法,该模型打破前后条件转移间的细致平衡,其对数似然梯度显式依赖于马尔可夫链的最后两步。这一连接非平衡统计物理与现代机器学习的探索表明,向隐变量模型引入不可逆性可提升生成数据分布的保真度。

原文摘要 · Abstract (English)

We show that nonequilibrium dynamics can play a constructive role in unsupervised machine learning by inducing the spontaneous emergence of latent-state cycles. We introduce a model in which visible and hidden variables interact through two independently parametrized transition matrices, defining a Markov chain whose steady state is intrinsically out of equilibrium. Likelihood maximization drives this system toward nonequilibrium steady states with finite entropy production, reduced self-transition probabilities, and persistent probability currents in the latent space. These cycles are not imposed by the architecture but arise from training, and models that develop them reproduce the empirical distribution of data classes more faithfully, with a clear correlation between agreement with the data and entropy production. Compared with equilibrium approaches such as restricted Boltzmann machines, our model breaks the detailed balance between the forward and backward conditional transitions and relies on a log-likelihood gradient that depends explicitly on the last two steps of the Markov chain. Hence, this exploration of the interface between nonequilibrium statistical physics and modern machine learning suggests that introducing irreversibility into latent-variable models can improve the fidelity of the generated data distribution.

生成模型非平衡动力学隐变量熵产

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。