ILL学出的规则可解释为概率图模型,揭示了其与最大熵模型的关系。
Information Lattice Learning as Probabilistic Graphical Model Structure Learning
- 将信号投影到分层抽象的划分格上,学习可解释的概率规则
- 规则集构成对商变量的边际约束,特殊提升实现最大无知重建
- 为符号-概率混合学习提供新方向,适合关注可解释性的研究者
当信号为概率质量函数时,信息格学习(ILL)所学出的概率规则可自然解释为概率图模型(PGM)。ILL中的划分诱导确定性商变量,规则即该商变量的边缘分布。规则集构成对可解释抽象的边际约束集合。一般提升对应满足这些约束的所有联合分布的可行族;特殊提升选择最大无知重建,由L2均匀性原理实现,与最大熵密切相关。在香农熵提升下,相同约束生成一个以学习到的抽象为索引的对数线性因子图。然而,信息格本身并非贝叶斯网络:其边表示抽象的细化或粗化,而非条件依赖。因此,ILL更宜视为对基于商变量的可解释约束因子图的结构学习。这一视角阐明了ILL与图模型及最大熵模型的关系,并为推理、可识别性及符号-概率混合学习指明新方向。
原文摘要 · Abstract (English)
Information lattice learning (ILL) learns interpretable rules of a signal by alternately projecting the signal onto a partition lattice that encodes a hierarchy of abstractions and lifting selected rules back to the signal domain. When the signal is a probability mass function, we show the probabilistic rules learned by ILL admit a natural probabilistic graphical model (PGM) interpretation and develop this interpretation in detail. A partition in ILL induces a deterministic quotient variable, and a rule is the marginal law of that quotient variable. A rule set is therefore a collection of marginal constraints over interpretable abstractions. General lifting is the feasible family of all joint distributions satisfying those constraints, while special lifting chooses a maximum-ignorance reconstruction, implemented in ILL by an L2 uniformity principle closely related to maximum entropy. Under a Shannon-entropy lifting, the same constraints yield a log-linear factor graph whose factors are indexed by learned abstractions. The information lattice itself, however, is not a Bayesian network: its edges encode refinement and coarsening of abstractions, not conditional dependence. Thus ILL is best viewed as structure learning for interpretable constraint-based factor graphs over quotient variables. This view clarifies how ILL relates to graphical models and maximum entropy models, while suggesting new directions for inference, identifiability, and hybrid symbolic-probabilistic learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。