arXiv:2605.05463cs.LGcs.AI2026-05

研究文本生成的生物医学图谱在噪声下的自监督学习表现,提出更鲁棒的框架。

Robustness of Graph Self-Supervised Learning to Real-World Noise: A Case Study on Text-Driven Biomedical Graphs

论文配图:Robustness of Graph Self-Supervised Learning to Real-World Noise: A Case Study on Text-Driven Biomedical Graphs
图 1 · 摘自论文原文
  • 构建自动图文图谱并融合图净化与自监督学习
  • 关系重建易受噪声影响,特征重建更稳定,接近干净图效果
  • 双向关系传播模型更适合嘈杂文本图,适合医疗领域应用

图自监督学习(GSSL)无需标签即可学习图表示,但现有研究假设图数据干净且人工标注。近年来自然语言处理进步使得从文本大规模自动提取知识图谱成为可能,为GSSL带来新机遇,同时也引入了大量现实噪声。此类噪声尚未被充分研究,因以往鲁棒性评估多依赖合成扰动。为此,我们首次对基于文本驱动的生物医学图谱进行无监督术语分类的GSSL方法全面评估。提出噪声感知的文本驱动图自监督学习框架(NATD-GSSL),整合自动图构建、图净化与GSSL。评估采用双图协议:以MedMentions提取的噪声图与统一医学语言系统(UMLS)的清洁参考图对比,通过共享黄金标准对齐。结果表明,不同预训练任务和图神经网络(GNN)架构在噪声下的鲁棒性差异显著。关系重建对噪声敏感,依赖良好定义的模式;特征重建则更鲁棒,性能接近干净图设定。对比目标总体受噪声影响较小,但对下游任务对齐敏感。GNN架构起关键作用:双向关系消息传递设计更适合噪声文本图,单向设计在干净图上表现更优。NATD-GSSL为真实噪声图上的GSSL应用提供实用指导,相比预训练语言模型基线最高提升7%。所有代码与基准公开于https://github.com/OthmaneKabal/MC2GAE。

原文摘要 · Abstract (English)

Graph Self-Supervised Learning (GSSL) offers a powerful paradigm for learning graph representations without labeled data. However, existing work assumes clean, manually curated graphs. Recent advances in NLP enable the large-scale automatic extraction of knowledge graphs from text, opening new opportunities for GSSL while introducing substantial real-world noise. This type of noise remains largely unexplored, as prior robustness studies typically rely on synthetic perturbations. To address this gap, we present the first comprehensive evaluation of GSSL methods on text-driven graphs for unsupervised term typing. We introduce Noise-Aware Text-Driven Graph GSSL (NATD-GSSL), a unified framework that combines automatic graph construction, graph refinement, and GSSL. Our evaluation follows a dual-graph protocol that contrasts a noisy graph derived from MedMentions with a clean Unified Medical Language System (UMLS) reference graph, aligned through a shared gold standard. Our results reveal variability in robustness across both pretext tasks and Graph Neural Network (GNN) architectures. Relation reconstruction is highly sensitive to noise and benefits from well-defined schemas, whereas feature reconstruction is considerably more robust, achieving performance comparable to clean-graph settings. Contrastive objectives are generally less affected by noise but depend strongly on alignment with downstream tasks. GNN architecture also plays a critical role: bidirectional relational message-passing designs are better suited to noisy, text-driven graphs, while unidirectional relational ones perform best on clean graphs. Overall, NATD-GSSL provides practical guidance for applying GSSL to real-world, noisy graphs and achieves up to a 7\% improvement over pretrained language model baselines. All code and benchmarks are publicly available at https://github.com/OthmaneKabal/MC2GAE.

图神经网络自监督学习生物医学噪声鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。