arXiv:2412.17228cs.AIcs.LG2024-12

用AI帮癌症患者匹配临床试验,开源且保护隐私。

MatchMiner-AI: Open-source, Privacy-preserving Cancer Clinical Trial Matching using Artificial Intelligence

  • 用大模型分析病历和试验条件,自动匹配适合的临床试验。
  • 在50名患者中,100%找到可参与试验,优于传统基因匹配方法。
  • 全程开源,医生可用,适合想提升试验匹配率的医疗机构。

临床试验对癌症治疗进步至关重要,但不足10%的成人患者参与。本文开发了开源隐私保护的MatchMiner-AI系统,与临床肿瘤学家共同设计,基于合成电子健康记录(EHR)数据训练。该系统利用开源权重的大语言模型(LLM)从非结构化病历文本中总结患者病史,并从试验入组文档中提取目标人群。通过嵌入与重排序模型蒸馏技术,实现试验与患者建议的检索与排序。多维度评估显示:在回溯性蒸馏保真度测试中,该流程在20个召回结果下的平均平均精度(MAP@20)提升至0.95(95% CI 0.95-0.96),远超基线模型的0.44(95% CI 0.44-0.45)。在50名患者的样本中,所有患者均被成功匹配试验,而基于规则的基因匹配系统仅覆盖19例(38%)。在256条建议中,80%被前沿大模型认为合理,高于规则方法的53%(113条建议)。项目已公开合成数据、模型权重、推理工具与演示前端。

原文摘要 · Abstract (English)

Background: Clinical trials are essential to advancing cancer treatments, but fewer than 10% of adults with cancer enroll in therapeutic trials. Open-source AI trial matching tools could democratize access to trial options. Methods: We created MatchMiner-AI, co-developed with practicing clinical oncologists and trained on synthetic electronic health record (EHR) data. It uses open-weight LLMs to summarize patient histories from unstructured EHR text and extract target populations from trial eligibility documents. Embedding and re-ranking models were distilled to retrieve and rank trial and patient suggestions. Multifaceted evaluation was performed, including retrospective quantification of distillation fidelity; applying a closed-source LLM as judge of patient summarization and matching; and evaluation of candidate matches by oncologists. Results: Across retrospective evaluations of distillation fidelity, the pipeline outperformed a baseline text-embedding model, improving mean average precision (MAP) at 20 from 0.44 (95% CI 0.44-0.45) to 0.95 (95% CI 0.95-0.96) for trial-enrolled patients and from 0.38 (95% CI 0.37-0.38) to 0.94 (95% CI 0.93-0.94) for patients who received standard of care therapies. In a 50-patient sample selected for comparison between MatchMiner-AI and a rules-based tumor genomic trial matching algorithm, MatchMiner-AI retrieved trials for all patients, as opposed to 19 patients (38%) who had tumor genomic data available. Among those 19 patients, 80% of 256 trial suggestions retrieved by MatchMiner-AI were deemed reasonable considerations by a frontier LLM, vs 53% of 113 suggestions retrieved by the rules-based approach. Conclusion: MatchMiner-AI is an open-source, open-weights, clinical trial matching AI pipeline for oncology. Synthetic training data, model weights, inference tools, and demonstration frontends are publicly available.

癌症AI匹配开源隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。