arXiv:2606.30064cs.LGmath.PR2026-06

数据驱动的分层能量模型,让学习状态从单一最优变为多重平衡态。

Data-Driven Energy-Based Learning via Gibbs Measures on Hierarchical Structures

论文配图:Data-Driven Energy-Based Learning via Gibbs Measures on Hierarchical Structures
图 1 · 摘自论文原文
  • 用数据构建能量势函数,生成基于吉布斯分布的学习状态集合。
  • 在特定条件下,系统可出现多解共存的相变现象,对应不同预测模式。
  • 适用于研究复杂系统中数据如何塑造多种可能的推理状态。

我们提出一种基于分层结构上吉布斯测度的数据驱动概率学习框架。与传统经验风险最小化仅寻找单一最优参数不同,本方法将经验损失转化为相互作用势,定义一个能量模型,其对应的吉布斯分布描述了由数据生成的一族平衡学习状态。我们推导了有限体积分布的一致性条件,并得到非线性积分不动点方程,其解刻画了可接受的学习状态。这些方程建立了经验损失景观与树状结构上的概率推断之间的严格联系。对于平移不变解,问题简化为由数据依赖核诱导的正紧算子分析,在一维情形下可建立解的存在性与唯一性条件。此外,我们发现分层学习系统可能出现相变:在凯莱树上,某些经验核在临界逆温度以上会引发多个吉布斯测度,对应不同的平衡预测区间。数值实验展示了非可分核下的多解分支现象,证实了多个数据诱导学习状态的共存。结果揭示了能量基学习的新视角:数据不仅通过最小化确定最优模型,更定义了一个完整的可能推理状态概率景观。

原文摘要 · Abstract (English)

We introduce a data-driven probabilistic framework for learning systems based on Gibbs measures on hierarchical structures. Unlike standard empirical risk minimization, where a dataset is used to identify a single optimal parameter, our approach transforms the empirical loss function into an interaction potential defining an energy-based model. The resulting Gibbs distribution describes a family of equilibrium learning states generated by the data. We formulate the consistency conditions of the associated finite-volume distributions and derive nonlinear integral fixed-point equations whose solutions characterize the admissible learning states. These equations provide a rigorous connection between empirical loss landscapes and probabilistic inference on trees. For translation-invariant solutions, the problem reduces to the analysis of positive compact operators induced by data-dependent kernels, allowing us to establish existence and uniqueness conditions in the one-dimensional setting. Furthermore, we show that hierarchical learning systems may exhibit phase-transition phenomena: for certain empirical kernels on Cayley trees, multiple Gibbs measures emerge beyond a critical inverse temperature, corresponding to distinct equilibrium prediction regimes. Numerical experiments with non-separable kernels illustrate the appearance of multiple solution branches and demonstrate the coexistence of several data-induced learning states. Our results provide a new perspective on energy-based learning, where data do not merely determine an optimal model through minimization but define an entire probabilistic landscape of possible inference states.

能量模型分层结构相变现象概率推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。