用形式化约束匹配临床试验,显著提升匹配准确率和召回率。
SatIR: Scalable High-Recall Constraint-Satisfaction-Based Information Retrieval for Clinical Trials Matching
- 将患者与试验的匹配转化为可验证的逻辑约束求解问题。
- 在标准数据集上比现有方法多找到32%-72%符合条件的试验。
- 兼顾高效检索与结果可解释性,适合医疗精准匹配场景。
现实中的检索与匹配任务不仅需主题相关,更需满足特定条件约束。临床试验匹配是高风险典型:虽有超过50万项试验在ClinicalTrials.gov上注册,每月吸引约两百万用户,但大量试验仍难达招募目标。现有基于关键词或嵌入相似性的方法将纳入条件视为软性信号,导致召回率低、精度差且难以解释。本文提出SatIR,一种基于形式化约束满足的可扩展、高效、高精度、高召回、可解释的临床试验检索方法。利用医学本体论,通过大语言模型(LLM)将模糊推理——如隐含临床假设、信息不全——转化为明确、精确、可控且可解释的可满足性模理论(SMT)约束。为实现高效检索,将SMT匹配问题投影至关系代数,支持数据库高效实现,在保持高召回的同时仅轻微损失精度。SatIR在SIGIR 2016和基于TREC 2022构建的基准上均优于相似性基线,相比TrialGPT风格方法,每名患者多检索出32%-72%的相关且符合资格的试验,在TREC基准上实现1.8-3.2倍更高的合格试验召回率。单次检索耗时仅146毫秒,覆盖3,621个SIGIR试验。
原文摘要 · Abstract (English)
Many real-world retrieval and matching problems require more than topical relevance: a candidate must satisfy the specific constraints of one profile among many, not just be relevant to it. Clinical trials are a high-stakes instance of this challenge: they are central to evidence-based medicine, yet many struggle to meet enrollment targets, despite the availability of over half a million trials listed on ClinicalTrials.gov, which attracts approximately two million users monthly. Existing retrieval techniques, largely based on keyword and embedding-similarity matching, treat eligibility constraints as soft signals rather than binding requirements, resulting in low recall, low precision, and limited interpretability. We propose SatIR, a scalable, efficient, high-precision, high-recall, interpretable clinical trial retrieval method based on formal constraint satisfaction. Leveraging established medical ontologies, we use Large Language Models (LLMs) to convert informal reasoning -- regarding ambiguity, implicit clinical assumptions, and incomplete patient records -- into explicit, precise, controllable, and interpretable formal Satisfiability Modulo Theories (SMT) constraints. For scalable and efficient retrieval, we project the SMT matching problem onto relational algebra, enabling an efficient database implementation that retains high recall while sacrificing little precision. SatIR consistently improves eligibility-aware retrieval over similarity-based baselines on the SIGIR 2016 dataset and a benchmark derived from TREC 2022. Relative to TrialGPT-style retrieval, SatIR retrieves 32%-72% more relevant-and-eligible trials per patient on SIGIR 2016 and achieves 1.8-3.2x higher eligible-trial recall on the TREC benchmark. Retrieval is fast, requiring only 146 milliseconds per patient over 3,621 SIGIR trials.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。