用层化结构直接建模异质图,性能提升且参数减少十倍。
Heterogeneous Sheaf Neural Networks
- 通过层化结构分配类型感知特征空间,用限制映射融合异质信息。
- 在多个任务上最高提升2个百分点,节点分类达94.97%宏F1,链接预测达99.62%。
- 适合处理复杂异质图数据,尤其对参数量敏感的应用场景。
异质图(节点与边可属不同类型和特征空间)广泛存在于生物、推荐、社交网络与计算机系统中。现有方法多通过关系专用模块或类型感知注意力等架构设计处理异质性,导致模型日益复杂且参数冗余。本文提出HetSheaf框架,通过细胞层化结构直接在数据层面建模异质性:为不同类型节点分配局部特征空间,并学习依赖于节点特征、类型及边类型的限制映射。为支持图级预测,进一步引入SheafPool,一种对局部基变换不变的通用总和读出机制,使图分类更严谨。实验表明,相比同质(GCN、GAT、GIN、GraphSAGE)、异质(R-GCN、HAT、HGT)及无类型感知的层化基线,HetSheaf在异质图基准(HGB)上持续提升最高2个百分点(节点分类最高94.97%宏F1,链接预测最高99.62%),同时参数量减少最多10倍。
原文摘要 · Abstract (English)
Heterogeneous graphs, whose nodes and edges can belong to different types and feature spaces, arise in many real-world domains, including biology, recommendation, social networks, and computer systems. Existing heterogeneous graph neural networks typically handle this heterogeneity at the architectural level through relation-specific modules, meta-path machinery or type-aware attention, which often leads to increasingly specialised parameter-heavy designs. In this work, we propose HetSheaf, a framework for learning heterogeneous graphs through cellular sheaves. Instead of encoding heterogeneity solely in the architecture, HetSheaf represents it directly in the underlying data structure by assigning type-aware local feature spaces and learning restriction maps conditioned on node features, node types, and edge types. To support graph-level prediction, we further introduce SheafPool, a universal stalk-space readout that aggregates node representations while being invariant to local changes of basis, thereby making graph classification with sheaf networks well-defined and achieving an F1 Score up to 42 percentage points higher than mean pooling. Across a diverse suite of benchmarks (node classification, link prediction and graph classification). HetSheaf consistently achieves up to 2 percentage points higher performance (up to 94.97% Macro F1 Score on node classification and up to 99.62% on link prediction) on the Heterogeneous Graph Benchmark (HGB) framework against homogeneous (GCN, GAT, GIN, GraphSAGE), heterogeneous (R-GCN, HAT, HGT) and type-agnostic sheaf baselines, while reducing the number of parameters by up to 10$\times$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。