arXiv:2601.20518cs.LGcs.AI2026-01

用状态空间模型提升高阶图学习,线性复杂度实现长程依赖建模

CCMamba: Topologically-Informed Selective State-Space Networks on Combinatorial Complexes for Higher-Order Graph Learning

  • 将高阶消息传递转化为可选的状态空间序列建模,实现线性时间计算
  • 在图、超图和单纯复形数据上均超越现有方法,深层网络不出现过平滑
  • 适合需要高效处理高阶关系的图神经网络研究者与应用开发者

拓扑深度学习已成为建模超出成对交互的高阶关系结构的强大范式,而组合复形(CCs)为高阶图学习提供了统一的拓扑基础。现有拓扑深度学习方法严重依赖局部消息传递和注意力机制,存在二次复杂度与邻域限制,制约了其可扩展性及秩感知的长程依赖建模能力。为此,我们提出首个基于Mamba的组合复形神经框架——CCMamba。通过将多秩关联关系线性化为结构化的秩感知序列,将高阶消息传递重构为选择性状态空间建模问题,实现自适应、方向性、长程信息传播,且计算复杂度为线性,突破了自注意力的可扩展瓶颈。理论上,我们证明了CCMamba的表达能力被1维组合复形Weisfeiler-Lehman测试所上限。在图、超图与单纯复形基准上的大量实验表明,CCMamba持续优于现有方法,展现出卓越的可扩展性与深层架构下的抗过平滑能力。

原文摘要 · Abstract (English)

Topological deep learning has emerged as a powerful paradigm for modeling higher-order relational structures beyond pairwise interactions that standard graph neural networks fail to capture. While combinatorial complexes (CCs) offer a unified topological foundation for the higher-order graph learning, existing topological deep learning methods rely heavily on local message passing and attention mechanisms. These suffer from quadratic complexity and local neighborhood constraints, limiting their scalability and capacity for rank-aware, long-range dependency modeling. To overcome these challenges, we propose Combinatorial Complex Mamba (CCMamba), the first unified Mamba-based neural framework for learning on combinatorial complexes. CCMamba reformulates higher-order message passing as a selective state-space modeling problem by linearizing multi-rank incidence relations into structured, rank-aware sequences. This architecture enables adaptive, directional, and long-range information propagation in linear time bypassing the scalability bottlenecks of self-attention. Theoretically, we further establish that the expressive power of CCMamba is upper-bounded by the 1-dimensional combinatorial complex Weisfeiler-Lehman (1-CCWL) test. Extensive experiments across graph, hypergraph, and simplicial benchmarks demonstrate that CCMamba consistently outperforms existing methods while exhibiting superior scalability and remarkable robustness against over-smoothing in deep architectures.

高阶图学习状态空间模型组合复形Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。