arXiv:2604.14616cs.CLcs.AI2026-04被引 1

用检索增强方法自动构建临床术语集,提升精准度与效率。

Retrieve, Then Classify: Corpus-Grounded Automation of Clinical Value Set Authoring

论文配图:Retrieve, Then Classify: Corpus-Grounded Automation of Clinical Value Set Authoring
图 1 · 摘自论文原文
  • 先检索相似术语集,再分类筛选候选代码,缩小搜索范围。
  • 相比纯检索,错误候选数减少至3.2个/真阳性,准确率提升至F1 0.298。
  • 适用于临床数据标准化、医学信息提取等场景,适合医疗AI研究者。

临床价值集编制——即识别标准术语集中定义某临床概念的所有代码——是临床质量评估与表型分析中的常见瓶颈。直接用大语言模型生成代码虽自然,但临床术语库规模大、版本受控,且在预训练中难以可靠记忆。我们提出检索增强的集合补全方法(RASC):从精选语料库中检索最相似的K个已有价值集构成候选池,再对每个候选代码进行分类。理论上,检索-选择可将有效输出空间从完整术语库缩小至小得多的候选池,降低统计复杂度。我们在11,803个公开的VSAC价值集中验证了RASC的有效性,构建了首个该任务的大规模基准。基于SAPBert微调的交叉编码器达到AUROC 0.852,价值集级F1为0.298,优于简单的三层MLP(AUROC 0.799,F1 0.250),并将每真阳性对应的无关候选数从12.3(仅检索)降至约3.2和4.4。零样本GPT-4o的值集级F1仅为0.105,且48.6%的返回代码不在VSAC中。性能差距随价值集增大而扩大,符合RASC的理论优势。在另一类交叉编码器和LightGBM模型上也观察到类似提升,表明其收益不局限于单一模型类型。代码及数据集可在https://github.com/mukhes3/RASC 获取。

原文摘要 · Abstract (English)

Clinical value set authoring -- the task of identifying all codes in a standardized vocabulary that define a clinical concept -- is a recurring bottleneck in clinical quality measurement and phenotyping. A natural approach is to prompt a large language model (LLM) to generate the required codes directly, but structured clinical vocabularies are large, version-controlled, and not reliably memorized during pretraining. We propose Retrieval-Augmented Set Completion (RASC): retrieve the $K$ most similar existing value sets from a curated corpus to form a candidate pool, then apply a classifier to each candidate code. Theoretically, retrieve-and-select can reduce statistical complexity by shrinking the effective output space from the full vocabulary to a much smaller retrieved candidate pool. We demonstrate the utility of RASC on 11,803 publicly available VSAC value sets, constructing the first large-scale benchmark for this task. A cross-encoder fine-tuned on SAPBert achieves AUROC~0.852 and value-set-level F1~0.298, outperforming a simpler three-layer Multilayer Perceptron (AUROC~0.799, F1~0.250) and both reduce the number of irrelevant candidates per true positive from 12.3 (retrieval-only) to approximately 3.2 and 4.4 respectively. Zero-shot GPT-4o achieves value-set-level F1~0.105, with 48.6\% of returned codes absent from VSAC entirely. This performance gap widens with increasing value set size, consistent with RASC's theoretical advantage. We observe similar performance gains across two other classifier model types, namely a cross-encoder initialized from pre-trained SAPBert and a LightGBM model, demonstrating that RASC's benefits extend beyond a single model class. The code to download and create the benchmark dataset, as well as the model training code is available at: \href{https://github.com/mukhes3/RASC}{https://github.com/mukhes3/RASC}.

医疗AI术语集检索增强大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。