揭示消息传递GNN模拟WL颜色精炼的资源成本与局限
How Hard Is It for Message-Passing GNNs to Simulate One Weisfeiler-Lehman Color-Refinement Step?
- 区分输入无关与实例相关模拟,分析参数配置代价
- 小消息尺寸下,浅层网络无法在最坏情况下完成模拟
- 大颜色集时,对数级随机位可显著降低所需资源
消息传递图神经网络(MPGNN)常与Weisfeiler-Lehman(WL)颜色精炼过程对比,但该对比未量化网络在有限消息大小和数值精度下实现颜色精炼所需的资源。本文研究无属性图上单步颜色精炼的模拟成本。区分输入无关(盲设)与实例相关模拟。结果表明,局部的WL精炼隐藏着全局重标记问题。在盲设设置中,确定性和零误差随机性MPGNN在最坏情况下无法用浅层小消息网络解决该问题。我们给出了一个更强的根节点、端口感知模型下的近似匹配构造。当颜色集合较大时,有界误差随机性可大幅降低开销,一层消息大小为对数级且使用对数级随机比特的MPGNN即可满足要求。我们证明该对数级随机比特数在浅层小消息模拟中本质上是必需的。颜色集合较小时,仍可在根节点、端口感知模型中实现模拟,但需更多层数或更大消息。我们还证明这一额外开销部分不可避免,因小颜色集导致层数与消息大小间的非平凡权衡。实例相关模拟可更浅,但所需特定参数未必易得。这些结果揭示了MPGNN与WL精炼等价性背后的量化结构。
原文摘要 · Abstract (English)
Message-passing graph neural networks (MPGNNs) are commonly compared with the Weisfeiler-Lehman (WL) color-refinement procedure, but this comparison does not quantify the resource parameters a network needs to realize color refinement with bounded-size messages and finite numerical precision. We study the cost of simulating a single color-refinement step on unattributed graphs. We distinguish input-independent, or oblivious, simulation from instance-dependent simulation. In the former, the parameters, or their distributions in randomized models, are fixed before the input instance is known. Our results show that the local form of WL color refinement hides a global relabeling problem. In the oblivious setting, deterministic and zero-error randomized MPGNNs cannot solve this problem in the worst case using only shallow networks with small messages. We complement this lower bound with a nearly matching construction in a stronger rooted, port-aware model. By contrast, when the color set is large, bounded-error randomness can greatly reduce the cost, and a one-layer MPGNN with messages of logarithmic size and a logarithmic number of random bits suffices. We show that this logarithmic number of random bits is essentially necessary for shallow, small-message simulations. When the color set is small, we still obtain a rooted, port-aware simulation, but this construction requires more layers or larger messages. We also prove that this extra cost is partly unavoidable, as small color sets force a nontrivial trade-off between the number of layers and the message size. Finally, instance-dependent simulation can be much shallower, but the required instance-specific parameters are not necessarily easy to find. Together, these results reveal quantitative structure hidden behind the statement that MPGNNs match WL color refinement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。