arXiv:2412.08160cs.LG2024-12AAAI被引 19

用状态空间模型提升动态图结构学习的效率与鲁棒性

DG-Mamba: Robust and Efficient Dynamic Graph Structure Learning with Selective State Space Models

  • 引入可选择的状态空间机制,线性化消息传递复杂度
  • 在对抗攻击下仍保持高鲁棒性,性能超越现有方法
  • 适合处理含噪声、不完整动态图数据的场景

动态图在现实世界中普遍存在,但其结构不完整、含噪声和冗余导致动态图神经网络鲁棒性差。动态图结构学习(DGSL)虽具潜力,却面临难以接受的二次复杂度及对启发式先验的过度依赖,难以发现深层预测模式。本文提出新型框架DG-Mamba,基于选择性状态空间模型(Mamba),通过核化动态消息传递将时间复杂度从二次降低为线性;构建自洽系统,以跨快照邻接矩阵离散化状态,实现长距离依赖捕捉;并设计自监督相关性原则,正则化最相关且最不冗余的信息,增强全局鲁棒性。大量实验表明,该方法在对抗攻击下依然显著优于现有最优基线。

原文摘要 · Abstract (English)

Dynamic graphs exhibit intertwined spatio-temporal evolutionary patterns, widely existing in the real world. Nevertheless, the structure incompleteness, noise, and redundancy result in poor robustness for Dynamic Graph Neural Networks (DGNNs). Dynamic Graph Structure Learning (DGSL) offers a promising way to optimize graph structures. However, aside from encountering unacceptable quadratic complexity, it overly relies on heuristic priors, making it hard to discover underlying predictive patterns. How to efficiently refine the dynamic structures, capture intrinsic dependencies, and learn robust representations, remains under-explored. In this work, we propose the novel DG-Mamba, a robust and efficient Dynamic Graph structure learning framework with the Selective State Space Models (Mamba). To accelerate the spatio-temporal structure learning, we propose a kernelized dynamic message-passing operator that reduces the quadratic time complexity to linear. To capture global intrinsic dynamics, we establish the dynamic graph as a self-contained system with State Space Model. By discretizing the system states with the cross-snapshot graph adjacency, we enable the long-distance dependencies capturing with the selective snapshot scan. To endow learned dynamic structures more expressive with informativeness, we propose the self-supervised Principle of Relevant Information for DGSL to regularize the most relevant yet least redundant information, enhancing global robustness. Extensive experiments demonstrate the superiority of the robustness and efficiency of our DG-Mamba compared with the state-of-the-art baselines against adversarial attacks.

动态图状态空间高效学习鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。