提出两种稳定算法,让贝叶斯网络学习结果不随变量顺序变化。
Stable Structure Learning with HC-Stable and Tabu-Stable Algorithms
- 基于贪心爬山法,通过确定稳定节点顺序消除变量顺序带来的不稳定性。
- Tabu-Stable在所有网络上获得最高BIC分数,类别网络准确率也最优。
- 适用于需要稳定结构学习的科研与工业场景,尤其关注连续变量建模。
许多贝叶斯网络结构学习算法存在不稳定性,其学习结果对数据集的任意特征(如变量列顺序)敏感。尽管PC-Stable试图解决广泛使用的PC算法的这一问题,但评分类算法中的类似问题却未受重视。本研究发现,多种主流评分类、混合及约束类算法(包括PC-Stable)均存在相同缺陷。为此,我们提出一种新型评分类贪心爬山方法,通过确定稳定节点顺序,实现无论变量顺序如何变化,结果始终保持一致。提出两种实现:HC-Stable与Tabu-Stable。实验表明,Tabu-Stable在所有网络上取得最高BIC得分,且在类别型网络中准确率最高。该工作扩展了此前在2024年概率图模型会议发表的研究,首次纳入连续变量建模。代码及使用说明已开源至GitHub:https://github.com/causal-iq/discovery。
原文摘要 · Abstract (English)
Many Bayesian Network structure learning algorithms are unstable, with the learned graph sensitive to arbitrary dataset artifacts, such as the ordering of columns (i.e., variable order). PC-Stable attempts to address this issue for the widely-used PC algorithm, prompting researchers to use the "stable" version instead. However, this problem seems to have been overlooked for score-based algorithms. In this study, we show that some widely-used score-based algorithms, as well as hybrid and constraint-based algorithms, including PC-Stable, suffer from the same issue. We propose a novel solution for score-based greedy hill-climbing that eliminates instability by determining a stable node order, leading to consistent results regardless of variable ordering. Two implementations, HC-Stable and Tabu-Stable, are introduced. Tabu-Stable achieves the highest BIC scores across all networks, and the highest accuracy for categorical networks. These results highlight the importance of addressing instability in structure learning and provide a robust and practical approach for future applications. This extends the scope and impact of our previous work presented at Probabilistic Graphical Models 2024 by incorporating continuous variables. The implementation, along with usage instructions, is freely available on GitHub at https://github.com/causal-iq/discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。