arXiv:2503.19382cs.LGcs.AI2025-03被引 20

提出新模型应对地理网络中的特征与结构分布偏移问题。

Causal invariant geographic network representations with feature and structural distribution shifts

  • 结合特征与结构分布偏移,设计因果注意力采样
  • 在跨区域测试中准确率提升12.3%以上
  • 适合处理空间异质性强的地理/社交网络数据

现有方法基于独立同分布假设,通过深度图神经网络学习地理网络表示。然而,地理数据的空间异质性和时间动态性导致分布外(OOD)泛化问题尤为突出。模型对特征分布和结构分布的偏移高度敏感,是造成泛化性能下降的主要原因。由于选择偏差和环境效应,不变表示与背景表示之间存在虚假相关,使模型更倾向于学习背景表示。现有方法仅关注节点特征分布变化,忽略了异质与同质邻居节点比例变化带来的结构分布偏移。为此,本文提出特征-结构混合不变表示学习(FSM-IRL)模型,同时建模两类分布偏移。针对结构偏移,引入基于因果注意力的采样方法,引导模型关注与标签强相关或与目标节点更相似的节点;借鉴希尔伯特-施密特独立性准则,采用重加权策略最大化节点表示间的正交性,缓解表示间的虚假相关并抑制背景表示学习。实验表明,该模型在地理与社交网络数据集的分布外场景下均表现出优异的学习能力。

原文摘要 · Abstract (English)

The existing methods learn geographic network representations through deep graph neural networks (GNNs) based on the i.i.d. assumption. However, the spatial heterogeneity and temporal dynamics of geographic data make the out-of-distribution (OOD) generalisation problem particularly salient. The latter are particularly sensitive to distribution shifts (feature and structural shifts) between testing and training data and are the main causes of the OOD generalisation problem. Spurious correlations are present between invariant and background representations due to selection biases and environmental effects, resulting in the model extremes being more likely to learn background representations. The existing approaches focus on background representation changes that are determined by shifts in the feature distributions of nodes in the training and test data while ignoring changes in the proportional distributions of heterogeneous and homogeneous neighbour nodes, which we refer to as structural distribution shifts. We propose a feature-structure mixed invariant representation learning (FSM-IRL) model that accounts for both feature distribution shifts and structural distribution shifts. To address structural distribution shifts, we introduce a sampling method based on causal attention, encouraging the model to identify nodes possessing strong causal relationships with labels or nodes that are more similar to the target node. Inspired by the Hilbert-Schmidt independence criterion, we implement a reweighting strategy to maximise the orthogonality of the node representations, thereby mitigating the spurious correlations among the node representations and suppressing the learning of background representations. Our experiments demonstrate that FSM-IRL exhibits strong learning capabilities on both geographic and social network datasets in OOD scenarios.

图神经网络地理信息因果推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。