提出能量模型解决混合贝叶斯网络推理问题,提升多模态与组合推理精度。
Free Energy Manifold: Score-Based Inference for Hybrid Bayesian Networks

- 用能量景观建模离散父节点嵌入与连续观测的条件关系
- 在合成数据上相比基线降低显著的KL散度,尤其在模式间中点表现更优
- 适合多模态或组合推理场景,不适用于简单分类任务
我们提出自由能流形(FEM),一种专为包含离散与连续变量的混合贝叶斯网络设计的得分训练条件能量模型。FEM将每个条件因子表示为基于学习得到的离散父节点嵌入和连续观测的能量景观,支持后验评估、生成采样及在条件独立性下通过能量叠加实现多连续叶节点的组合推理。核心发现是模式桥缺陷:标准条件能量模型会在同类别分离模式之间形成低能脊线,导致数据外内部点产生过度自信的后验。我们分析此问题并提出谷地正则化,一种数据外校准项,可在保持数据内拟合的同时恢复这些区域的近似均匀后验。在多个合成多模态混合贝叶斯网络基准测试中,FEM 显著降低相对于经典基线和原始条件EBM的KL散度,尤其在模式桥中点查询和多叶证据组合任务中取得大幅改进。我们也评估了高基数离散父节点设置及UCI乳腺癌数据集的合理性验证,表明FEM在需要多模态或组合推理时最有价值,而判别分类器仍更适合封闭世界分类任务。
原文摘要 · Abstract (English)
We introduce the Free Energy Manifold (FEM), a score-trained conditional energy model specialized for inference in hybrid Bayesian networks with discrete and continuous variables. FEM represents each conditional factor as an energy landscape over learned discrete-parent embeddings and continuous observations, enabling posterior evaluation, generative sampling, and compositional inference across multiple continuous leaves by energy addition under conditional independence. A central finding is the mode-bridge artifact: standard conditional energy models can create low-energy ridges between separated modes of the same class, producing overconfident posteriors at off-data interior points. We analyze this failure and propose valley regularization, an off-data calibration term that restores near-uniform posteriors in such regions while preserving in-data fit. Across synthetic multimodal hybrid-BN benchmarks, FEM substantially reduces KL divergence relative to classical baselines and a vanilla conditional EBM, including large gains at mode-bridge midpoint queries and in multi-leaf evidence composition. We also evaluate high-cardinality discrete-parent settings and a UCI Breast Cancer sanity check, showing that FEM is most useful when multimodal or compositional Bayesian-network inference is required, while discriminative classifiers remain preferable for closed-world classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。