arXiv:2602.21216cs.CLcs.AI2026-02

用医学实体增强语言模型,自动识别论文是否使用EQ-5D量表

EQ-5D Classification Using Biomedical Entity-Enriched Pre-trained Language Models and Multiple Instance Learning

  • 用scispaCy提取医学实体,增强BERT类模型输入
  • 在研究级上实现0.82的F1分数和近乎完美的召回率
  • 适合做健康经济学文献综述自动化筛选的人群

EQ-5D是评估健康相关生活质量的标准工具。在健康经济学中,系统性文献综述依赖于准确识别使用EQ-5D的文献,但手动筛查大量科学文献耗时、易错且不一致。本研究探索了通用(BERT)和领域专用(SciBERT、BioBERT)预训练语言模型(PLMs)的微调,通过scispaCy模型为每条语句提取生物医学实体信息进行增强,以提升从摘要中检测EQ-5D的能力。我们进行了九种实验设置,包括三种scispaCy模型与三种PLMs的组合,并在句子和研究层级评估性能。此外,我们采用多实例学习(MIL)方法结合注意力池化,将句子级信息聚合为研究级预测,每个摘要被视为一个由增强句子组成的“包”。结果表明,F1分数达到0.82,研究级召回率接近完美,显著优于传统的词袋基线和近期报告的PLM基线。这说明实体增强能显著提升领域适配性和模型泛化能力,实现更精准的自动化文献筛选。

原文摘要 · Abstract (English)

The EQ-5D (EuroQol 5-Dimensions) is a standardized instrument for the evaluation of health-related quality of life. In health economics, systematic literature reviews (SLRs) depend on the correct identification of publications that use the EQ-5D, but manual screening of large volumes of scientific literature is time-consuming, error-prone, and inconsistent. In this study, we investigate fine-tuning of general-purpose (BERT) and domain-specific (SciBERT, BioBERT) pre-trained language models (PLMs), enriched with biomedical entity information extracted through scispaCy models for each statement, to improve EQ-5D detection from abstracts. We conduct nine experimental setups, including combining three scispaCy models with three PLMs, and evaluate their performance at both the sentence and study levels. Furthermore, we explore a Multiple Instance Learning (MIL) approach with attention pooling to aggregate sentence-level information into study-level predictions, where each abstract is represented as a bag of enriched sentences (by scispaCy). The findings indicate consistent improvements in F1-scores (reaching 0.82) and nearly perfect recall at the study-level, significantly exceeding classical bag-of-words baselines and recently reported PLM baselines. These results show that entity enrichment significantly improves domain adaptation and model generalization, enabling more accurate automated screening in systematic reviews.

自然语言处理医学文本分析文献筛选

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。