让图模型懂几何,提升跨领域文本图迁移学习效果
GraphShaper: Geometry-aware Alignment for Improving Transfer Learning in Text-Attributed Graphs
- 按图结构特性动态分配超球面、双曲等几何空间,分治编码
- 零样本下引文网络提效9.47%,社交网络提效7.63%
- 适合处理树状/环状结构混合的复杂图数据
图基础模型为跨图领域学习可迁移表征提供了变革性范式。现有方法利用大语言模型将图与文本模态统一到共享表示空间,采用对比学习。然而系统评估发现,在拓扑模式交汇的结构边界处性能显著下降,准确率损失超过20个百分点。根源在于当前方法假设所有图结构可嵌入单一欧氏空间:树状结构需双曲几何以保持层级分支,环状结构依赖球面几何实现闭合性。在结构边界处,节点面临冲突的几何约束,统一空间无法解决。为此,我们提出几何感知框架GraphShaper,通过多几何专业化增强图编码。该方法使用针对不同几何空间设计的专家网络,动态计算融合权重,根据局部结构特征自适应整合几何属性,从而在对齐文本嵌入前保持结构完整性。大量实验表明,GraphShaper在零样本设置下,引文网络准确率提升9.47%,社交网络提升7.63%。
原文摘要 · Abstract (English)
Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared representation space using contrastive learning. However, systematic evaluations reveal significant performance degradation at structural boundaries where distinct topological patterns converge, with accuracy losses exceeding 20 percentage points. This issue arises from a key limitation: current methods assume all graph structures can be encoded within a single Euclidean space. In reality, tree structures require hyperbolic geometry to preserve hierarchical branching, while cyclic patterns depend on spherical geometry for closure properties. At structural boundaries, nodes experience conflicting geometric constraints that uniform encoding spaces cannot resolve. This raises a crucial challenge: \textbf{Can alignment frameworks be designed to respect the intrinsic geometric diversity of graph structures?} We introduce \textbf{GraphShaper}, a geometry-aware framework that enhances graph encoding through multi-geometric specialization. Our approach employs expert networks tailored to different geometric spaces, dynamically computing fusion weights to adaptively integrate geometric properties based on local structural characteristics. This adaptive fusion preserves structural integrity before alignment with text embeddings. Extensive experiments demonstrate that GraphShaper achieves 9.47\% accuracy improvements on citation networks and 7.63\% on social networks in zero-shot settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。