arXiv:2411.18954cs.LGcs.AI2024-11被引 1

用神经重参数化方法,高效求解复杂马尔可夫随机场的最优推理问题。

ReMAP: Neural Reparameterization for Scalable MAP Inference in Arbitrary-Order Markov Random Fields

  • 用图神经网络生成标签分布,通过梯度优化在连续空间找低能离散解
  • 在合成数据和真实PCI问题上,比传统方法更快且能量更低
  • 无需标注数据,支持任意阶因子与异构标签,适合大规模场景

在任意阶马尔可夫随机场(MRF)中实现可扩展的高质量最大后验(MAP)推断仍具挑战。近似消息传递方法虽高效,但在密集或高阶实例上性能下降;而精确求解器如Toulbar2在规模扩大时成本剧增。本文提出ReMAP,一种针对每个MRF实例独立优化的神经重参数化框架,直接优化原始MRF能量的可微松弛。该方法不依赖监督标签或摊销训练:图神经网络生成节点级标签分布,梯度优化在过参数化连续空间中搜索低能离散解。支持成对与任意阶因子、异构标签基数,并可在GPU上高效执行,无需标注解。我们证明松弛目标与离散MAP问题一致,并分析神经过参数化如何揭示原离散空间中不可达的低能路径。实验证明,在合成成对与高阶MRF、UAI 2022基准以及真实物理小区标识(PCI)问题上,ReMAP持续优于近似基线,且在硬性大规模实例上常以合理时间预算找到低于Toulbar2的能量解。

原文摘要 · Abstract (English)

Scalable high-quality MAP inference in arbitrary-order Markov Random Fields (MRFs) remains challenging. Approximate message-passing methods are often efficient but can degrade on dense or high-order instances, while exact solvers such as Toulbar2 become increasingly expensive at scale. We present ReMAP, an instance-wise neural reparameterization framework that directly optimizes a differentiable relaxation of the original MRF energy. Instead of relying on supervised labels or amortized training, ReMAP treats each MRF as an independent optimization problem: a Graph Neural Network produces node-wise label distributions, and gradient-based optimization searches for a low-energy discrete solution in an over-parameterized continuous space. The method supports pairwise and arbitrary-order factors, heterogeneous label cardinalities, and efficient GPU execution, without requiring labeled solutions. We show that the relaxed objective is consistent with the discrete MAP problem and analyze how neural over-parameterization can expose low-energy optimization paths unavailable in the original discrete space. Empirically, on synthetic pairwise and high-order MRFs, UAI 2022 inference benchmarks, and real-world Physical Cell Identity (PCI) problems, ReMAP consistently outperforms approximate baselines and often finds lower-energy solutions than Toulbar2 on hard large-scale instances within practical time budgets.

图神经网络马尔可夫随机场优化推理神经重参数化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。