无需重训练,实时对齐图结构提升模型鲁棒性
Structural Alignment Improves Graph Test-Time Adaptation
- 推理时动态调整邻居权重与节点表示平衡
- 在多个数据集上显著超越现有图神经网络方法
- 适合隐私受限或计算资源不足的图学习场景
基于图的学习在推荐、欺诈检测和粒子物理等领域的交互模式建模中表现优异,但在网络连接分布发生改变时性能常下降。现有方法通常需使用源数据集重新训练,但受计算或隐私限制难以实现。本文提出测试时图结构对齐(TSA),一种无需重训练即可在推理阶段对齐图结构的图测试时自适应方法。基于对图数据分布偏移的理论理解,TSA采用三种协同策略:基于不确定性的邻域加权以应对邻居标签分布变化,根据信噪比自适应平衡节点与聚合邻域表示,以及优化决策边界修正残留的标签与特征偏移。在合成与真实世界数据集上的大量实验表明,TSA持续优于非图类测试时自适应方法及当前最优图测试时自适应基线。
原文摘要 · Abstract (English)
Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering network connectivity. Current methods to address these shifts typically require retraining with the source dataset, which is often infeasible due to computational or privacy limitations. We introduce Test-Time Structural Alignment (TSA), a novel algorithm for Graph Test-Time Adaptation (GTTA) that adapts a pretrained model to align graph structures during inference without the cost of retraining. Grounded in a theoretical understanding of graph data distribution shifts, TSA employs three synergistic strategies: uncertainty-aware neighborhood weighting to accommodate neighbor label distribution shifts, adaptive balancing of self-node and aggregated neighborhood representations based on their signal-to-noise ratio, and decision boundary refinement to correct residual label and feature shifts. Extensive experiments on synthetic and real-world datasets demonstrate TSA's consistent outperformance of both non-graph TTA methods and state-of-the-art GTTA baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。