arXiv:2410.07908eess.IVcs.AI2024-10被引 11

ONCOPILOT让医生用点击框选就能精准分割肿瘤,比现有模型更准。

ONCOPILOT: A Promptable CT Foundation Model For Solid Tumor Evaluation

  • 用点选和框选提示交互式分割3D肿瘤,无需复杂标注
  • 在RECIST 1.1测量上达到放射科医生水平,误差小于5%
  • 适合临床医生快速评估,提升肿瘤量化一致性

癌症发生具有高度异质性,肿瘤可出现在不同部位并呈现复杂多样的形态。当前生物标志物如RECIST 1.1的长径与短径测量难以捕捉这种复杂性,仅提供肿瘤负荷的粗略估计。现有监督AI模型受限于标注稀缺和任务狭窄,难以应对肿瘤表现的多样性。为此,我们开发了ONCOPILOT——一个基于约7,500张全身CT扫描训练的可提示放射学基础模型,涵盖正常解剖与多种肿瘤病例。该模型支持以点选、框选等视觉提示进行3D肿瘤分割,性能超越nnUnet等先进模型,在RECIST 1.1测量中达到放射科医生级精度。其核心优势在于保持放射科医生参与的同时实现超越现有模型的表现;当医生交互式修正分割结果时,准确率进一步提升。该模型显著加速测量流程,降低阅片者间差异,推动体积分析与新型生物标志物的发展。预计将提升RECIST 1.1的测量精度,释放体积生物标志物潜力,改善患者分层与临床管理,并无缝融入放射科工作流。

原文摘要 · Abstract (English)

Carcinogenesis is a proteiform phenomenon, with tumors emerging in various locations and displaying complex, diverse shapes. At the crucial intersection of research and clinical practice, it demands precise and flexible assessment. However, current biomarkers, such as RECIST 1.1's long and short axis measurements, fall short of capturing this complexity, offering an approximate estimate of tumor burden and a simplistic representation of a more intricate process. Additionally, existing supervised AI models face challenges in addressing the variability in tumor presentations, limiting their clinical utility. These limitations arise from the scarcity of annotations and the models' focus on narrowly defined tasks. To address these challenges, we developed ONCOPILOT, an interactive radiological foundation model trained on approximately 7,500 CT scans covering the whole body, from both normal anatomy and a wide range of oncological cases. ONCOPILOT performs 3D tumor segmentation using visual prompts like point-click and bounding boxes, outperforming state-of-the-art models (e.g., nnUnet) and achieving radiologist-level accuracy in RECIST 1.1 measurements. The key advantage of this foundation model is its ability to surpass state-of-the-art performance while keeping the radiologist in the loop, a capability that previous models could not achieve. When radiologists interactively refine the segmentations, accuracy improves further. ONCOPILOT also accelerates measurement processes and reduces inter-reader variability, facilitating volumetric analysis and unlocking new biomarkers for deeper insights. This AI assistant is expected to enhance the precision of RECIST 1.1 measurements, unlock the potential of volumetric biomarkers, and improve patient stratification and clinical care, while seamlessly integrating into the radiological workflow.

医学影像肿瘤分割交互式AI基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。