arXiv:2608.02558cs.LG2026-08

首次系统评估剪枝神经网络在归纳任务中的表现,发现其设计选择对性能影响有限。

Benchmarking Sheaf Neural Networks for Inductive Tasks

论文配图:Benchmarking Sheaf Neural Networks for Inductive Tasks
图 1 · 摘自论文原文
  • 用可学习的限制映射替代传统图神经网络的标量边权,实现更灵活的消息传递。
  • 1890次实验表明,剪枝结构本身对性能影响较小,架构组件才是关键。
  • 剪枝模型可跨数据集通用,调优外围架构比调整剪枝算子更有效。

剪枝神经网络(SNNs)通过将标准图神经网络(GNNs)中节点间的标量边权重替换为可学习的、依赖边的限制映射,实现了消息传递的泛化。尽管其理论基础扎实且在归纳任务中表现良好,但现有研究几乎仅限于归纳节点分类,缺乏对归纳协议下行为的评估。本文首次系统性地基准测试了剪枝设计空间,涵盖三种扩散机制(神经剪枝扩散、剪枝注意力、剪枝注意力与GATv2结合)、三种限制映射参数化形式、三种栈维度及六种现代GNN架构组件,采用无需组装重型剪枝拉普拉斯矩阵的消息传递重构方法,使整个设计空间可在跨图批量训练中可微。在14个归纳数据集上开展1,890次受控实验,结果表明:限制映射是主导设计因素,通用映射更优;更大栈维度增加容量但不提升长程传播能力;架构组件解释的性能差异远超整个剪枝特定设计空间本身。在匹配协议下,SNNs可迁移至归纳设置,但未达到最强基线,差距因数据集而异。实践中,单一剪枝配置可跨数据集泛化,因此应优先优化外围架构而非剪枝算子本身。

原文摘要 · Abstract (English)

Sheaf Neural Networks (SNNs) generalize message passing by replacing scalar edge weights of standard Graph Neural Networks (GNNs) with learnable, edge-dependent restriction maps between node stalks. Despite their strong theoretical foundations and promising transductive results, SNNs have been evaluated almost exclusively on transductive node classification, leaving their behaviour under inductive protocols unknown. We address this gap through the first systematic benchmark of the sheaf design space, evaluating three diffusion mechanisms (neural sheaf diffusion, sheaf attention, and sheaf attention with Graph Attention Network v2), three restriction-map parameterizations, three stalk dimensions, and six modern GNN architectural components, within a message-passing reformulation that never assembles the heavy sheaf Laplacian, making the full design space trainable under cross-graph batching. Across $1{,}890$ controlled experiments on 14 inductive datasets, multiple insights emerge: restriction maps are the dominant design choice and general maps are preferable, larger stalks add capacity but not long-range reach, architectural components explain more performance variation than the entire sheaf-specific design space itself. Under a matched protocol, SNNs transfer to inductive settings but do not reach the strongest baselines, with gaps being dataset-dependent. Practically, a single sheaf configuration can generalize across datasets, so effort is better spent tuning the surrounding architectural recipe than the sheaf operator itself.

图神经网络剪枝网络归纳学习架构设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。