用AI自动从海量文献中挖掘有效干预措施,精准发现2421项语音语言治疗方案。
Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Framework
- 通过分层引导提示和双模型协作,实现自动化文献标注
- 在6万篇论文中识别出2421项干预措施,准确率显著提升
- 专为临床研究设计,适合医疗知识图谱构建者使用
从科学文献中识别有效干预措施面临出版物数量庞大、术语专业、报告格式不一等挑战,手动整理耗时且易遗漏。本文提出一种新框架,结合渐进式本体提示(POP)算法与双代理系统(LLM-Duo),实现全自动干预发现。POP算法在预定义本体中执行优先级广度优先搜索,生成结构化提示模板与操作序列以指导标注。LLM-Duo包含探索者与评估者两个专用大模型代理,协同且对抗性地持续优化标注质量。通过语音语言干预发现的案例研究验证了该框架的实际应用价值。实验结果表明,该方法超越先进基线,在64,177篇文献中成功识别出2,421项干预措施,形成公开可访问的干预知识库,具有重要临床应用潜力。
原文摘要 · Abstract (English)
Identifying effective interventions from the scientific literature is challenging due to the high volume of publications, specialized terminology, and inconsistent reporting formats, making manual curation laborious and prone to oversight. To address this challenge, this paper proposes a novel framework leveraging large language models (LLMs), which integrates a progressive ontology prompting (POP) algorithm with a dual-agent system, named LLM-Duo. On the one hand, the POP algorithm conducts a prioritized breadth-first search (BFS) across a predefined ontology, generating structured prompt templates and action sequences to guide the automatic annotation process. On the other hand, the LLM-Duo system features two specialized LLM agents, an explorer and an evaluator, working collaboratively and adversarially to continuously refine annotation quality. We showcase the real-world applicability of our framework through a case study focused on speech-language intervention discovery. Experimental results show that our approach surpasses advanced baselines, achieving more accurate and comprehensive annotations through a fully automated process. Our approach successfully identified 2,421 interventions from a corpus of 64,177 research articles in the speech-language pathology domain, culminating in the creation of a publicly accessible intervention knowledge base with great potential to benefit the speech-language pathology community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。