用神经网络指导局部搜索,提升概率图模型推理效率
Learning to Guide Local Search for MPE Inference in Probabilistic Graphical Models
- 训练注意力网络预测动作对逼近最优解的贡献
- 在高树宽基准上显著优于传统局部搜索算法
- 适合需要反复推理同一模型的场景
概率图模型中的最大可能解释(MPE)推理是诊断、规划和结构化预测等领域的基础问题,但计算复杂。在许多实际应用中,图模型固定而证据模式不断变化,需重复进行推理。随机局部搜索(SLS)虽可扩展至大规模模型,但依赖仅关注即时似然提升的短视规则,常陷入次优局部极小。引导局部搜索(GLS+)通过修改搜索空间缓解此问题,但其引导信息无法在相同模型的多个查询间复用。本文提出一种神经摊销框架,在重复查询场景下改进局部搜索:利用固定的图结构,训练基于注意力的网络来评估局部动作的潜力,预测其减少汉明距离至近似最优解的能力。该方法无缝集成至现有局部搜索流程,通过平衡短期似然增益与长期前景来选择邻居。我们提供了理论直觉,说明减少距离的动作选择有助于改善收敛性,并在高树宽基准上实证证明了其在摊销推理设置中持续优于SLS和GLS+。
原文摘要 · Abstract (English)
Most Probable Explanation (MPE) inference in Probabilistic Graphical Models (PGMs) is a fundamental yet computationally challenging problem arising in domains such as diagnosis, planning, and structured prediction. In many practical settings, the graphical model remains fixed while inference must be performed repeatedly for varying evidence patterns. Stochastic Local Search (SLS) algorithms scale to large models but rely on myopic best-improvement rule that prioritizes immediate likelihood gains and often stagnate in poor local optima. Heuristics such as Guided Local Search (GLS+) partially alleviate this limitation by modifying the search landscape, but their guidance cannot be reused effectively across multiple inference queries on the same model. We propose a neural amortization framework for improving local search in this repeated-query regime. Exploiting the fixed graph structure, we train an attention-based network to score local moves by predicting their ability to reduce Hamming distance to a near-optimal solution. Our approach integrates seamlessly with existing local search procedures, using this signal to balance short-term likelihood gains with long-term promise during neighbor selection. We provide theoretical intuition linking distance-reducing move selection to improved convergence behavior, and empirically demonstrate consistent improvements over SLS and GLS+ on challenging high-treewidth benchmarks in the amortized inference setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。