轻量级对齐方法让生物医学文本与知识图谱高效匹配。
Aligning Biomedical Texts and Knowledge Graphs: A Systematic Comparison of Lightweight Alignment Strategies
- 用对比学习在冻结模型间加轻量投影,实现文本与图谱对齐。
- 将文本映射到图谱空间时,线性投影+三元组拼接效果最佳。
- 研究发现训练方向和三元组组合比编码器选择影响更大。
生物医学知识以非结构化文献和结构化知识图谱(KG)两种形式存在。对齐二者对知识溯源、证据检索和图谱补全至关重要,但现有方法未显式对齐自由文本与图谱三元组。本文提出统一框架,系统研究对齐设计选择。采用冻结的文本编码器与KG嵌入模型,仅通过对比目标学习两者间的轻量投影。涵盖六种设计维度:文本编码器、KG嵌入模型、投影头、三元组组合方式、训练方向及硬负样本采样。构建了包含22,000余个一对一三元组-文档对的CTD-Align数据集,链接比较毒理基因组数据库中的化学-基因相互作用与支持性PubMed段落。在文档到三元组和三元组到文档两种检索任务上评估。结果表明,三元组组合方式与训练方向(即共享检索空间)影响最大,而文本编码器与硬负样本采样影响较小。最优策略为:使用线性投影头,将主语、谓词、宾语嵌入拼接后投影至图谱空间。该发现确立轻量级对比对齐作为连接生物医学文本与图谱的有效且实用基础。
原文摘要 · Abstract (English)
Biomedical knowledge exists in two complementary but distinct forms: unstructured scientific literature and structured knowledge graphs (KGs). Aligning them is essential for knowledge grounding, evidence retrieval, and KG completion, yet existing methods do not explicitly align free-text evidence with KG triples. We present a unified framework for systematically studying design choices for aligning biomedical text and KGs. With a text encoder and a KG embedding model both frozen, we learn only a lightweight projection between their spaces via a contrastive objective. This enables a fair comparison across six design dimensions: text encoder, KG embedding model, projection head, triple composition, training direction, and hard-negatives sampling. We construct CTD-Align, a corpus of over 22K one-to-one tripledocument pairs linking chemical-gene interactions from the Comparative Toxicogenomics Database to supporting PubMed passages. We evaluate alignment on it in two retrieval settings: document-to-triple and triple-to-document. We find that the triple composition and the training direction (i.e., shared retrieval space) have the greatest impact, whereas the text encoder and hard-negatives sampling matter little. Overall, simple choices win: projecting text into the KG space with a linear head over concatenated subject, predicate, and object embeddings performs best. These findings establish lightweight contrastive alignment as an effective, practical foundation for bridging biomedical text and KGs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。