arXiv:2504.06722cs.LGcond-mat.stat-mech2025-04被引 4

用可解释的张量树模型拟合数据分布,自动发现隐藏结构。

Plastic tensor networks for interpretable generative modeling

  • 基于非负自适应张量树构造可解释的概率图模型,自动搜索最优树结构。
  • 在二值运算、贝叶斯网络和线粒体DNA聚类任务中,负对数似然表现接近量子生成模型。
  • 适合关注模型可解释性与结构推断的研究者,尤其适用于生物信息学等场景。

提出一种单层非负自适应张量树(NATT)的结构优化方法,用于建模目标概率分布,作为生成建模的新范式。NATT通过构造自动搜索最适合给定离散数据集的树结构,其特征作为输入,并具有作为概率图模型的可解释性优势。本文对比了NATT与近期提出的玻恩机自适应张量树(BMATT)优化方案,在多个生成建模任务中验证其有效性,目标是推断数据集的隐藏结构。结果表明,在最小化负对数似然方面,单层方案性能与玻恩机方案相当,但未更优。任务包括推断二值位运算结构、仅从可观测节点学习随机贝叶斯网络内部结构,以及基于线粒体DNA序列构建系统发育树(克劳多格)的真实世界案例。研究还展示了网络拓扑选择的重要性,以及最小互信息准则在候选结构选择中的通用性,并讨论了此类张量树生成模型的信息含量与可解释性。

原文摘要 · Abstract (English)

A structural optimization scheme for a single-layer nonnegative adaptive tensor tree (NATT) that models a target probability distribution is proposed as an alternative paradigm for generative modeling. The NATT scheme, by construction, automatically searches for a tree structure that best fits a given discrete dataset whose features serve as inputs, and has the advantage that it is interpretable as a probabilistic graphical model. We consider the NATT scheme and a recently proposed Born machine adaptive tensor tree (BMATT) optimization scheme and demonstrate their effectiveness on a variety of generative modeling tasks where the objective is to infer the hidden structure of a provided dataset. Our results show that in terms of minimizing the negative log-likelihood, the single-layer scheme has model performance comparable to the Born machine scheme, though not better. The tasks include deducing the structure of binary bitwise operations, learning the internal structure of random Bayesian networks given only visible sites, and a real-world example related to hierarchical clustering where a cladogram is constructed from mitochondrial DNA sequences. In doing so, we also show the importance of the choice of network topology and the versatility of a least-mutual information criterion in selecting a candidate structure for a tensor tree, as well as discuss aspects of these tensor tree generative models including their information content and interpretability.

可解释建模张量网络结构推断概率图模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。