arXiv:2409.09704cs.CLcs.IR2024-09中稿 · Methods被引 28

用大模型无监督提取临床试验中的关键信息,省去人工标注麻烦。

AlpaPICO: Extraction of PICO Frames from Clinical Trial Documents Using LLMs

  • 基于大模型预训练知识,无需标注数据即可提取PICO要素。
  • 在EBM-NLP等数据集上达到与有监督方法相当的准确率。
  • 适合医疗文本挖掘、系统综述自动化研究者使用。

近年来临床试验报告数量激增,系统综述面临时间压力。自动提取人群、干预、对照和结局(PICO)可缓解传统手动筛选的负担。现有方法依赖人工标注的BIO标签数据,而最近的上下文学习(ICL)虽有效,仍需标注示例。本文采用ICL策略,利用大语言模型(LLM)预训练阶段积累的知识,在无监督条件下自动提取临床试验文档中的PICO术语。此外,为验证在标注数据充足时的表现,采用指令微调结合低秩适配(LORA)的方法,在资源受限环境下训练巨模型,实现高效微调。实验表明,基于ICL的框架在所有EBM-NLP数据集版本上表现良好;指令微调版本在多个数据集上达到当前最优效果。项目开源:https://github.com/shrimonmuke0202/AlpaPICO.git。

原文摘要 · Abstract (English)

In recent years, there has been a surge in the publication of clinical trial reports, making it challenging to conduct systematic reviews. Automatically extracting Population, Intervention, Comparator, and Outcome (PICO) from clinical trial studies can alleviate the traditionally time-consuming process of manually scrutinizing systematic reviews. Existing approaches of PICO frame extraction involves supervised approach that relies on the existence of manually annotated data points in the form of BIO label tagging. Recent approaches, such as In-Context Learning (ICL), which has been shown to be effective for a number of downstream NLP tasks, require the use of labeled examples. In this work, we adopt ICL strategy by employing the pretrained knowledge of Large Language Models (LLMs), gathered during the pretraining phase of an LLM, to automatically extract the PICO-related terminologies from clinical trial documents in unsupervised set up to bypass the availability of large number of annotated data instances. Additionally, to showcase the highest effectiveness of LLM in oracle scenario where large number of annotated samples are available, we adopt the instruction tuning strategy by employing Low Rank Adaptation (LORA) to conduct the training of gigantic model in low resource environment for the PICO frame extraction task. Our empirical results show that our proposed ICL-based framework produces comparable results on all the version of EBM-NLP datasets and the proposed instruction tuned version of our framework produces state-of-the-art results on all the different EBM-NLP datasets. Our project is available at \url{https://github.com/shrimonmuke0202/AlpaPICO.git}.

医学文本PICO提取大模型应用无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。