arXiv:2511.09042cs.LG2025-11被引 1

提出新方法缓解文本图中语义漂移,提升模型表达能力。

GeoGNN: Quantifying and Mitigating Semantic Drift in Text-Attributed Graphs

  • 基于局部PCA量化语义漂移,分析聚合方式对语义流形的影响。
  • 设计测地线聚合机制,保持文本嵌入在球面流形上的几何结构。
  • 在4个数据集上超越主流模型,适合文本图学习与语义建模场景。

文本属性图(TAGs)上的图神经网络通常使用预训练语言模型(PLMs)编码节点文本,并通过线性邻域聚合传播嵌入表示。然而,现代PLM的表示空间高度非线性且具有几何结构,文本嵌入位于弯曲的语义流形上而非平坦的欧氏空间。在线性聚合此类流形时,几何结构不可避免地被扭曲,导致语义漂移——即聚合表示偏离内在流形,丧失语义保真度与表达力。为此,本文提出一种基于局部主成分分析(PCA)的度量方法,首次建立定量分析框架,揭示不同聚合机制对流形结构的影响。在此基础上,我们提出测地线聚合(Geodesic Aggregation),通过单位球面上的对数-指数映射沿测地线聚合邻居信息,确保消息传递过程中表示始终忠于语义流形。进一步构建了GeoGNN,融合球面注意力与流形插值机制。在四个基准数据集和多种文本编码器上进行的大量实验表明,GeoGNN显著缓解语义漂移,持续优于强基线模型,证明了流形感知聚合在文本属性图学习中的重要性。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) on text--attributed graphs (TAGs) typically encode node texts using pretrained language models (PLMs) and propagate these embeddings through linear neighborhood aggregation. However, the representation spaces of modern PLMs are highly non--linear and geometrically structured, where textual embeddings reside on curved semantic manifolds rather than flat Euclidean spaces. Linear aggregation on such manifolds inevitably distorts geometry and causes semantic drift--a phenomenon where aggregated representations deviate from the intrinsic manifold, losing semantic fidelity and expressive power. To quantitatively investigate this problem, this work introduces a local PCA--based metric that measures the degree of semantic drift and provides the first quantitative framework to analyze how different aggregation mechanisms affect manifold structure. Building upon these insights, we propose Geodesic Aggregation, a manifold--aware mechanism that aggregates neighbor information along geodesics via log--exp mappings on the unit sphere, ensuring that representations remain faithful to the semantic manifold during message passing. We further develop GeoGNN, a practical instantiation that integrates spherical attention with manifold interpolation. Extensive experiments across four benchmark datasets and multiple text encoders show that GeoGNN substantially mitigates semantic drift and consistently outperforms strong baselines, establishing the importance of manifold--aware aggregation in text--attributed graph learning.

图神经网络语义漂移流形学习文本图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。