arXiv:2608.26587cs.CL2026-08中稿 · EMNLP

通过优化轨迹分析发现,医学知识图谱可实现精准的模型对齐提升诊断推理能力。

Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models

论文配图:Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models
图 1 · 摘自论文原文
  • 用梯度密度与畸变指标量化模型更新范围,识别出稀疏、局部的精准对齐模式
  • 在相同任务准确率下,稀疏更新的模型推理质量显著优于密集更新方法
  • 适合关注大模型医学推理可解释性与稳定性研究的研究者

生物医学知识图谱(KG)提供了结构化医学知识,可用于在临床诊断中锚定大语言模型(LLM)的推理过程,但如何将KG信号有效融入LLM仍是一个开放问题。我们开展了一项系统研究,涵盖五种KG任务形式、三种训练范式、两个知识图谱和三个基础LLM。在任务层面,所有范式均优于非微调基线,但表现相近的模型在知识迁移行为上存在显著差异。我们引入梯度干预密度(GID)和梯度畸变(GD)来衡量优化器对预训练模型修改的广度。GID与GD共同揭示出明显分界:在KL正则化下的KG判断训练产生稀疏、局部的更新(我们称之为‘手术式对齐’),而特定任务的SFT则产生密集更新。受控消融实验表明,目标函数与KL正则化独立贡献于稀疏性;且产生稀疏更新的范式即使在域内准确率较低时,仍能提升推理质量。因此,评估KG-LLM融合效果需结合准确性与优化几何诊断。代码见 https://github.com/LARK-NLP-Lab/Surgical-Alignment。

原文摘要 · Abstract (English)

Biomedical knowledge graphs (KGs) offer structured medical knowledge that can ground large language model (LLM) reasoning in clinical diagnosis application, yet how KG signal should be integrated into LLMs remains an open question. We present a systematic study spanning five KG task formulations, three training paradigms, two KGs, and three base LLMs. At the task level, all paradigms improve over the non-finetuned baseline, but methods with comparable in-domain accuracy show substantially different knowledge transfer behavior. We introduce Gradient Intervention Density (GID) and Gradient Distortion (GD) to measure how broadly an optimizer modifies the pretrained model. GID and GD together reveal a clear divide: KG-judgment training under KL regularization produces sparse, localized updates (a regime we term as surgical alignment), while task-specific SFT produces dense ones. A controlled ablation shows that the objective and KL contribute to sparsity independently, and the paradigms that produce sparse updates also improve reasoning quality, even when their in-domain accuracy is lower than task-specific SFT. Assessing KG-LLM integration thus requires complementing accuracy with optimization-geometry diagnostics. Our implementation can be found at https://github.com/LARK-NLP-Lab/Surgical-Alignment.

知识图谱大模型对齐临床诊断优化分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。