解决图神经网络中缺失特征的结构过拟合问题,提升跨图泛化能力。
Mitigating Structural Overfitting: A Distribution-Aware Rectification Framework for Missing Feature Imputation
- 通过全局结构增强扩大扩散范围,缓解离散图上的信息传播不足。
- 设计掩码自编码语义修正器,恢复自然语义细节并减少过平滑。
- 测试时分布修正机制有效缩小结构偏差,适合冷启动推荐等场景。
真实场景中的节点特征缺失普遍存在,如用户画像和冷启动推荐,严重制约图学习系统(如GNN)的实际部署。现有方法多依赖基于扩散的结构平滑(如特征传播)来填补缺失值,但存在结构过拟合问题,导致三个渐进性挑战:1)在分离图上性能下降;2)因过平滑损失语义多样性;3)在未见图结构上泛化时出现特征分布偏移(归纳任务)。为此,我们提出{ extbf{\ ext{DART}}}框架。首先引入{ extit{全局结构增强(GSA)}},建立全局关联以连接离散组件并扩展扩散范围。在此基础上,设计基于掩码自编码的语义修正器,学习潜在特征流形以恢复自然语义细节。关键的是,提出测试时分布修正机制,在推理阶段将结构有偏特征投影回学习到的流形,有效弥合归纳分布差距。此外,考虑到合成掩码无法反映真实稀疏性,我们构建了新数据集{ extbf{Sailing}},来自航行记录的真实缺失属性。在六个公开数据集和Sailing上的大量实验表明, ext{DART}在归纳与归纳设置下均显著优于现有最优方法。代码与数据集已开源。
原文摘要 · Abstract (English)
Incomplete node features are ubiquitous in real-world scenarios such as user profiling and cold-start recommendation, which severely hinders the practical deployment of graph learning systems (e.g., GNNs). Existing solutions typically rely on diffusion-based structural smoothing (e.g., feature propagation) to impute missing values. However, we find that these approaches suffer from structural overfitting, leading to three progressive challenges: 1) performance degradation on disjoint graphs, 2) loss of semantic diversity due to over-smoothing, and 3) feature distribution shift when generalizing to unseen graph structures (inductive tasks). To address these challenges, we introduce the \textbf{\DART} framework. It begins by employing {\em Global Structural Augmentation (GSA)}, which establishes global correlations to bridge disjoint components and extend diffusion coverage. Building upon this, we design a semantic rectifier based on masked autoencoding. This module learns the latent feature manifold to recover natural semantic details. Crucially, we introduce a test-time distribution rectification mechanism that projects structurally biased features back onto the learned manifold during inference, effectively bridging the inductive distribution gap. Furthermore, considering that synthetic masking fails to reflect real-world sparsity, we present a new dataset \textbf{Sailing} collected from voyage records with naturally missing attributes. Extensive experiments on six public datasets and Sailing demonstrate that \DART significantly outperforms state-of-the-art methods in both transductive and inductive settings. Our code and dataset are available at https://github.com/yfsong00/DART.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。