提出DuoGNN模型,解决图神经网络过平滑与过挤压问题。
DuoGNN: Topology-aware Graph Neural Network with Homophily and Heterophily Interaction-Decoupling
- 通过拓扑边缘过滤分离同质与异质边,提升模型泛化性
- 采用异质图压缩技术实现大规模图的高效处理
- 双通道聚合机制有效缓解过平滑与过挤压,适合各类图结构
图神经网络在医学影像自动诊断等任务中表现优异,但其基于消息传递的局部邻域聚合机制存在两大根本缺陷:一是因异质节点聚合导致节点嵌入难以区分(过平滑),二是通过图瓶颈聚合造成信息传递受阻(过挤压)。这些限制阻碍了模型表达能力,使深层网络难以捕捉图中长程依赖关系。现有解决方案或因时间复杂度高难以处理大规模图,或无法适应所有图结构。为此,本文提出DuoGNN,一种可扩展且通用的架构,利用图拓扑解耦同质与异质边,捕捉短程与长程交互。核心贡献包括:(i) 拓扑边缘过滤算法,提取同质交互,提升对任意图结构的泛化能力;(ii) 异质图压缩技术,提取异质交互,保障可扩展性;(iii) 双通道同质与异质聚合管道,防止消息传递过程中的过平滑与过挤压。在医疗与非医疗节点分类数据集上进行基准测试,结果表明,DuoGNN在各项任务中均一致优于其变体。代码已开源:https://github.com/basiralab/DuoGNN。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these models, they inherently suffer from two fundamental limitations: first, indistinguishable node embeddings due to heterophilic node aggregation (known as over-smoothing), and second, impaired message passing due to aggregation through graph bottlenecks (known as over-squashing). These challenges hinder the model expressiveness and prevent us from using deeper models to capture long-range node dependencies within the graph. Popular solutions in the literature are either too expensive to process large graphs due to high time complexity or do not generalize across all graph topologies. To address these limitations, we propose DuoGNN, a scalable and generalizable architecture which leverages topology to decouple homophilic and heterophilic edges and capture both short-range and long-range interactions. Our three core contributions introduce (i) a topological edge-filtering algorithm which extracts homophilic interactions and enables the model to generalize well for any graph topology, (ii) a heterophilic graph condensation technique which extracts heterophilic interactions and ensures scalability, and (iii) a dual homophilic and heterophilic aggregation pipeline which prevents over-smoothing and over-squashing during the message passing. We benchmark our model on medical and non-medical node classification datasets and compare it with its variants, showing consistent improvements across all tasks. Our DuoGNN code is available at https://github.com/basiralab/DuoGNN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。