用医学领域Transformer模型检测临床试验中的用药错误,提升安全监控能力。
CaresAI at CT-DEB26: Detecting Dosing Errors In Clinical Trials Using Domain-Specific Transformer Embeddings and Classification Models

- 用BioBERT等医学专用模型编码临床试验文本,结合结构化特征
- 最佳模型达0.853的ROC-AUC,显著优于基线模型
- 适合医疗安全监测与监管决策支持场景
用药错误,特别是临床试验中的剂量错误,可能导致患者伤害、不良反应及更差的治疗结果。此类错误可预防,早期识别有助于保障试验完整性并减轻后续临床与财务负担。本研究通过使用在生物医学语料上训练的Transformer语言模型,评估临床试验信息的文本表征以检测剂量错误。采用ClinicalBERT、PubMedBERT、BioBERT和MedCPT对试验文本数据进行编码,并融合类别特征。这些文本嵌入作为输入,用于经典机器学习模型与神经网络架构的实验框架中。主要评估指标为预测剂量错误的ROC-AUC。在逻辑回归基线基础上,BioBERT表现最优,达到0.794的ROC-AUC,较ClinicalBERT基线提升3.95%。多嵌入融合未带来性能提升,表明领域对齐比表示堆叠更重要。梯度提升模型、支持向量分类器、逻辑回归和残差神经网络表现最佳,其ROC-AUC范围为0.821至0.853。总体而言,领域专用Transformer嵌入与结构化元数据的结合,可有效区分高剂量错误风险试验,推动安全监测并支持监管决策。
原文摘要 · Abstract (English)
Medication errors, particularly dosing errors in clinical trials (CT), can lead to patient harm, adverse drug events and worse patient outcomes. Dosing errors are preventable, and early identification can improve trial integrity and mitigate subsequent clinical and financial burden. This study aims to detect dosing errors within CT protocols by evaluating text representations of trial information using transformer-based language models trained on biomedical corpora. CT textual data was encoded using several models, including ClinicalBERT, PubMedBERT, BioBERT, and MedCPT, and integrated with categorical features. These text embeddings were used as input to classical machine learning models and neural network architectures within an experimental framework. Performance was primarily assessed using ROC-AUC with respect to predicting dosage error. Under a logistic regression baseline, BioBERT consistently outperformed alternative encoders, achieving an ROC-AUC of 0.794, a 3.95% improvement over the ClinicalBERT baseline. Combining multiple embeddings did not yield improvements, indicating that domain alignment outweighs representational stacking. Gradient boosting models, support vector classifiers, logistic regression, and residual neural networks achieved the strongest performance for predicting dosage error, achieving ROC-AUCs: 0.821 to 0.853. Overall, the integration of domain-specific transformer embeddings with structured metadata enables discrimination of trials meeting a predefined elevated dosing error risk criterion, advancing safety monitoring and supporting informed regulatory decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。