SIFTING框架让大模型从病历中提取肿瘤分期信息,结果可追踪、可验证。
SIFTING: A Novel LLM-Based Framework for Structured and Transparent Information Extraction from Clinical Free-Text Reports, with Application to Tumor Staging in Lung Cancer

- 用分段处理+结构化提示控制输出,确保每条结论有原文依据
- 在130份肺癌报告上准确率达90%(95%置信区间84-95)
- 适合需要可解释性与数据安全的临床场景,支持本地部署
大型语言模型(LLMs)在提取临床自由文本信息方面表现良好,但输出常不结构化且缺乏可追溯性,阻碍其在临床流程中的应用。本文提出SIFTING框架,结合LLM的语言理解能力与分段处理、结构化提示及严格输出控制,将提取结果与原始文本关联,实现准确且透明的信息抽取。为验证效果,我们将其应用于从130份肺癌放射科报告中提取肿瘤T分期(SIFTING-T-stage)。采用开源模型Llama-3.3-70B的4位量化紧凑版本(35 GB),在完全自托管环境下运行,保障数据与模型控制。性能通过四位临床专家构建的参考标准评估,并与多种主流LLM的单提示方法进行比较,使用自助抽样估计置信区间。结果显示,SIFTING-T-stage准确率为90%(95%置信区间:84–95),表现与具备推理能力的最大规模先进模型相当,且与临床专家结果无显著差异(p < 0.001),同时提供完整的溯源能力。结论表明,SIFTING可实现从临床自由文本中准确、结构化且可追溯的信息提取,确保数据可控、结果可复现、输出可验证,有助于临床验证与工作流集成。
原文摘要 · Abstract (English)
Background: Large language models (LLMs) show promise for extracting information from clinical free-text documents, but their outputs are often unstructured and lack traceability, complicating validation and adoption in clinical workflows. In this work we introduce SIFTING, an LLM-based framework designed to address these shortcomings. Methods: SIFTING combines the language comprehension capabilities of LLMs with segment-level processing and structured prompts with strict output control, linking findings to the source text to enable both accurate and transparent information extraction. To demonstrate its capabilities, we applied the framework to the task of extracting tumor T-stage information from 130 lung cancer radiology reports (SIFTING-T-stage). A compact 4-bit quantized version of the open-source LLM Llama-3.3-70B (35 GB) was used in a fully self-hosted setup, providing full control over data and model. Performance was evaluated against a reference standard created by four clinical experts and compared with a range of LLMs as used in a conventional single-prompt approach, using bootstrap resampling to estimate confidence intervals. Results: SIFTING-T-stage achieved an accuracy of 90% (95% CI: 84-95) against the reference standard. We found its performance to be comparable to even the largest state-of-the-art LLMs with reasoning capabilities and to be interchangeable with clinical experts (p < 0.001), while at the same time offering full traceability through source text references. Conclusion: SIFTING enables accurate, structured, and traceable information extraction from clinical free-text documents. It ensures data control, reproducibility, and verifiable outputs that can support clinical validation and workflow integration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。