提出自适应传播方法,提升有向图神经网络的性能与灵活性。
Toward Effective Digraph Representation Learning: A Magnetic Adaptive Propagation based Approach
- 引入可插拔的复杂域传播优化策略,自动调整传播规则。
- 在12个数据集上验证,支持大规模有向图建模,效果优于现有方法。
- 适合需要高效、自适应建模有向图结构的研究者使用。
基于 $q$-参数磁拉普拉斯的有向图卷积(MagDG)通过复数域消息传递编码节点特征与结构信息,在建模超大规模有向图拓扑方面表现优异。然而,现有方法存在两大局限:(1) $q$-参数需人工设计,依赖下游任务调参,影响模型灵活性并增加人工成本;(2) 消息传递方式粗粒度,所有节点采用统一规则,忽略其独特上下文,导致性能受限。为此,本文提出两项关键技术:(1) MAP 是一种即插即用的复数域传播优化策略,可无缝集成至任意 MagDG,提升预测性能且运行高效;(2) MAP++ 是新提出的有向图学习框架,引入可学习机制,在复数域实现边级自适应传播与节点级聚合,进一步提升性能。在12个数据集上的实验表明,MAP 具备良好灵活性与可扩展性,适用于网络规模有向图;MAP++ 在4类下游任务中达到当前最优(SOTA)性能。
原文摘要 · Abstract (English)
The $q$-parameterized magnetic Laplacian serves as the foundation of directed graph (digraph) convolution, enabling this kind of digraph neural network (MagDG) to encode node features and structural insights by complex-domain message passing. As a generalization of undirected methods, MagDG shows superior capability in modeling intricate web-scale topology. Despite the great success achieved by existing MagDGs, limitations still exist: (1) Hand-crafted $q$: The performance of MagDGs depends on selecting an appropriate $q$-parameter to construct suitable graph propagation equations in the complex domain. This parameter tuning, driven by downstream tasks, limits model flexibility and significantly increases manual effort. (2) Coarse Message Passing: Most approaches treat all nodes with the same complex-domain propagation and aggregation rules, neglecting their unique digraph contexts. This oversight results in sub-optimal performance. To address the above issues, we propose two key techniques: (1) MAP is crafted to be a plug-and-play complex-domain propagation optimization strategy in the context of digraph learning, enabling seamless integration into any MagDG to improve predictions while enjoying high running efficiency. (2) MAP++ is a new digraph learning framework, further incorporating a learnable mechanism to achieve adaptively edge-wise propagation and node-wise aggregation in the complex domain for better performance. Extensive experiments on 12 datasets demonstrate that MAP enjoys flexibility for it can be incorporated with any MagDG, and scalability as it can deal with web-scale digraphs. MAP++ achieves SOTA predictive performance on 4 different downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。