arXiv:2605.05330cs.LGcs.AI2026-05

提出一种快速二值化图优化方法,解决加权最大独立集问题。

Graph Normalization: Fast Binarizing Dynamics for Differentiable MWIS

  • 基于图动力系统设计可微分近似算法,实现快速收敛。
  • 在百万边真实数据上秒级求解,精度达最优结果的99%以上。
  • 适合需要约束下硬决策的深度学习场景,如稀疏注意力与网络剪枝。

我们提出图归一化(Graph Normalization, GN),一种定义在图上的原则性动力系统,作为NP难的最大权重独立集(MWIS)问题的可微分近似引擎。MWIS涵盖最优分配、调度、集合打包及离散马尔可夫随机场的MAP推断等组合难题。与信念传播不同,我们证明GN始终收敛到最大独立集的二值指示。GN通过精确的极大化-极小化步骤实现快速拟牛顿下降,持续改进MWIS松弛原始目标。我们建立GN与非势博弈中复制者动力学的等价关系,其中顶点竞争进入独立集。尽管是非势博弈,但GN遵循费希尔自然选择基本定理:平均适应度等于MWIS原始目标且严格上升。该联系导出Motzkin-Straus定理的加权扩展,表明独立集与倾斜单纯形上二次型的局部极小点一一对应。在分配问题中,GN表现为一种变体的Sinkhorn算法,能自然收敛至硬分配并推广至任意约束图。我们展示GN作为当前先进Bregman-Sinkhorn松弛MWIS求解器的快速二值化引擎,在包含100万条边的真实基准上,仅用数秒即可找到接近最优解(误差<1%)的解。GN为需要带约束的可微“硬”决策的深度学习架构开辟新路径,适用于结构化稀疏注意力、动态网络剪枝和专家混合模型。超越核心AI,GN框架支持计算机视觉、计算生物学和资源分配中的端到端约束优化学习。

原文摘要 · Abstract (English)

We introduce Graph Normalization (GN), a principled dynamical system on graphs that serves as a differentiable approximation engine for the NP-hard Maximum Weight Independent Set (MWIS) problem. MWIS encompasses many combinatorial challenges, including optimal assignment, scheduling, set packing, and MAP inference in discrete Markov Random Fields. Unlike Belief Propagation, we prove GN always converges to a binary indicator of a Maximum Independent Set. GN realizes a fast quasi-Newton descent through an exact Majorization-Minimization step, systematically improving the MWIS relaxed primal objective. We establish an equivalence between GN and the Replicator Dynamics of a nonlinear evolutionary game, where vertices compete for inclusion in an independent set. While a non-potential game, the GN game follows Fisher's Fundamental Theorem of Natural Selection, where the average fitness equals the MWIS primal objective and strictly increases. This connection leads to a weighted extension of the Motzkin-Straus theorem, showing MISes are in bijection with the local minima of a quadratic form over a tilted simplex. For the Assignment Problem, GN acts as a variant of the Sinkhorn algorithm that naturally converges to a hard assignment while generalizing to arbitrary constraint graphs. We demonstrate GN's performance as a fast binarization engine for the state-of-the-art Bregman-Sinkhorn relaxed MWIS solver. On real-world benchmarks with up to 1M edges, GN identifies solutions within 1% of the best known results in seconds on a CPU. GN opens new avenues for deep learning architectures requiring differentiable, "hard" decisions under constraints, with applications in structured sparse attention, dynamic network pruning, and Mixture-of-Experts. Beyond core AI, the GN framework enables end-to-end learning of constrained optimization in computer vision, computational biology, and resource allocation.

图神经网络优化算法可微分推理组合优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。