用大模型自动填肺癌瘤会表,准确率达80%。
Evaluation of Oncotimia: An LLM based system for supporting tumour boards
- 用多层数据湖+RAG+规则引擎,把病历转成标准表格
- 最佳模型准确率80%,响应时间对临床可用
- 适合想减负的肿瘤科医生和医院信息化团队
多学科肿瘤会诊(MDTB)在癌症决策中至关重要,但需手动处理大量异构临床信息,带来沉重文档负担。本文提出ONCOTIMIA,一个模块化且安全的临床工具,将生成式AI融入肿瘤科工作流,评估其使用大语言模型(LLMs)自动完成肺癌瘤会表的效果。系统结合多层数据湖、混合关系型与向量存储、检索增强生成(RAG)及规则驱动的自适应表单模型,将非结构化临床文档转化为结构化、标准化的瘤会记录。我们在10个肺癌病例上评估了通过AWS Bedrock部署的6个LLM,测量表单填写准确率和端到端延迟。结果显示各模型表现优异,最佳配置达到80%字段填写正确率,多数模型响应时间在临床可接受范围内。更大、更近期的模型准确性更高,且未产生不可接受的延迟。研究证实,基于LLM的自动补全表单在多学科肺癌工作流中技术可行、运行可行,有望显著减轻文档负担,同时保持数据质量。
原文摘要 · Abstract (English)
Multidisciplinary tumour boards (MDTBs) play a central role in oncology decision-making but require manual processes and structuring large volumes of heterogeneous clinical information, resulting in a substantial documentation burden. In this work, we present ONCOTIMIA, a modular and secure clinical tool designed to integrate generative artificial intelligence (GenAI) into oncology workflows and evaluate its application to the automatic completion of lung cancer tumour board forms using large language models (LLMs). The system combines a multi-layer data lake, hybrid relational and vector storage, retrieval-augmented generation (RAG) and a rule-driven adaptive form model to transform unstructured clinical documentation into structured and standardised tumour board records. We assess the performance of six LLMs deployed through AWS Bedrock on ten lung cancer cases, measuring both completion form accuracy and end-to-end latency. The results demonstrate high performance across models, with the best performing configuration achieving an 80% of correct field completion and clinically acceptable response time for most LLMs. Larger and more recent models exhibit best accuracies without incurring prohibitive latency. These findings provide empirical evidence that LLM- assisted autocompletion form is technically feasible and operationally viable in multidisciplinary lung cancer workflows and support its potential to significantly reduce documentation burden while preserving data quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。