arXiv:2608.03154cs.CL2026-08

用符号推理+外部知识提升LLM在生物医学关系抽取中的准确率。

ANCHOR-RE: An Agentic Neuro-Symbolic Framework for Grounded Biomedical Relation Extraction

论文配图:ANCHOR-RE: An Agentic Neuro-Symbolic Framework for Grounded Biomedical Relation Extraction
图 1 · 摘自论文原文
  • 结合本体引导推理与外部知识,让LLM推理更可靠。
  • 在多个数据集上比直接提示提升性能,最高微F1达0.872。
  • 无需微调即可稳定运行,适合医疗文献挖掘场景。

生物医学关系抽取(BioRE)旨在从文献中提取结构化知识,用于知识库构建与假说生成。传统符号系统如SemRep精度高但召回率低,而大语言模型(LLMs)虽具强上下文理解能力,却易产生误报。本文提出ANCHOR-RE框架,将本体引导推理、外部知识接地与数据驱动验证规则融入LLM推理流程。在SemRepGS、DDI和ChemProt三个基准上评估,使用专有与开源权重的LLMs均表现优异。在2026年发表的100篇新文献上的时间划分测试中,随机抽样500条预测人工评估精度达69%,且在未见文献上保持稳定。相较于直接提示,其在SemRepGS上微F1从0.654升至0.676,DDI从0.769升至0.872,ChemProt从0.939升至0.941。在DDI和ChemProt上超越仅推理方法,接近微调模型效果。开源模型也展现类似增益,表明该框架不依赖特定模型。结果证明,神经符号推理可在无参数更新下显著提升基于LLM的BioRE可靠性。

原文摘要 · Abstract (English)

Biomedical relation extraction (BioRE) extracts structured knowledge from biomedical literature for applications such as knowledge base construction and hypothesis generation. Traditional symbolic systems such as SemRep provide high precision but limited recall, while large language models (LLMs) offer stronger contextual reasoning but remain prone to false-positive predictions. We developed ANCHOR-RE, a framework that integrates ontology-guided reasoning, external knowledge grounding, and data-driven verification rules into LLM inference. We evaluated it on three BioRE benchmarks (SemRepGS, DDI, and ChemProt) using both proprietary and open-weight LLMs. To assess generalizability beyond benchmark datasets while reducing potential evaluation bias from LLM pretraining contamination, we conducted a temporal evaluation using 100 biomedical articles published in 2026. With the proprietary backbone, ANCHOR-RE outperformed direct LLM prompting, improving micro-F1 from 0.654 to 0.676 on SemRepGS, from 0.769 to 0.872 on DDI, and from 0.939 to 0.941 on ChemProt. On DDI and ChemProt, it also outperformed previously reported inference-only methods and approached fine-tuned or instruction-tuned systems without parameter updates. Similar performance gains observed with open-weight LLMs indicate that the benefits were not limited to the proprietary backbone. On the post-cutoff set, manual assessment of 500 randomly sampled predictions yielded a precision of 69%, maintaining consistent precision on previously unseen biomedical literature. Neuro-symbolic reasoning can improve the reliability of LLM-based BioRE without fine-tuning. Results across multiple benchmarks, model families, and post-cutoff literature support ANCHOR-RE as a practical training-free approach to biomedical literature mining.

生物医学关系抽取神经符号LLM推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。