arXiv:2603.19596cs.IR2026-03

让图结构和语义相互进化,解决异质图学习中的错误传播问题。

CO-EVOLVE: Bidirectional Co-Evolution of Graph Structure and Semantics for Heterophilous Learning

  • 双向迭代优化:图神经网络与大模型互为提示,动态更新结构与语义。
  • 在多个基准上准确率提升9.07%,F1分数提升7.19%。
  • 适合处理异质图、需避免幻觉的复杂关系建模场景。

将大语言模型(LLMs)与图神经网络(GNNs)结合有望统一语义理解与结构推理,但现有方法多依赖静态、单向流程,存在三大缺陷:(1)双向误差传播,使语义幻觉或结构噪声永久影响下游模态;(2)异质场景中语义相似性与拓扑实际矛盾;(3)盲目对齐导致模型互相复制错误。为此,我们提出CO-EVOLVE,一种双视角协同演化框架,将图拓扑与语义嵌入视为动态互增强的潜在变量。采用高斯-赛德尔交替优化策略,构建循环反馈:GNN以软提示注入结构上下文引导LLM,LLM则构建有利的动态语义图重连GNN。引入三项创新:(1)基于硬结构冲突感知的对比损失,重塑语义流形以尊重高阶拓扑边界;(2)自适应节点门控机制,动态融合静态与可学习结构以恢复缺失链接;(3)不确定性门控一致性策略,实现元认知对齐,仅从可信视图学习。推理时采用熵感知自适应融合。大量实验表明,CO-EVOLVE显著优于当前最优基线,在准确率上平均提升9.07%,F1分数提升7.19%。

原文摘要 · Abstract (English)

The integration of Large Language Models (LLMs) and Graph Neural Networks (GNNs) promises to unify semantic understanding with structural reasoning, yet existing methods typically rely on static, unidirectional pipelines. These approaches suffer from fundamental limitations: (1) Bidirectional Error Propagation, where semantic hallucinations in LLMs or structural noise in GNNs permanently poison the downstream modality without opportunity for recourse; (2) Semantic-Structural Dissonance, particularly in heterophilous settings where textual similarity contradicts topological reality; (3) a Blind Leading the Blind phenomenon, where indiscriminate alignment forces models to mirror each other's mistakes regardless of uncertainty. To address these challenges, we propose CO-EVOLVE, a dual-view co-evolution framework that treats graph topology and semantic embeddings as dynamic, mutually reinforcing latent variables. By employing a Gauss-Seidel alternating optimization strategy, our framework establishes a cyclic feedback loop: the GNN injects structural context as Soft Prompts to guide the LLM, while the LLM constructs favorable Dynamic Semantic Graphs to rewire the GNN. We introduce three key innovations to stabilize this evolution: (1) a Hard-Structure Conflict-Aware Contrastive Loss that warps the semantic manifold to respect high-order topological boundaries; (2) an Adaptive Node Gating Mechanism that dynamically fuses static and learnable structures to recover missing links; (3) an Uncertainty-Gated Consistency strategy that enables meta-cognitive alignment, ensuring models only learn from the confident view. Finally, an Entropy-Aware Adaptive Fusion integrates predictions during inference. Extensive experiments on public benchmarks demonstrate that CO-EVOLVE significantly outperforms state-of-the-art baselines, achieving average improvements of 9.07% in Accuracy and 7.19% in F1-score.

图神经网络大模型异质图协同优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。