首个基于AI基础模型的食管胃连接部腺癌诊断系统,提升内镜筛查与分期准确性。
Development and validation of an AI foundation model for endoscopic diagnosis of esophagogastric junction adenocarcinoma: a cohort and deep learning study
- 融合DINOv2与ResNet50,捕捉内镜图像全局外观与局部细节特征。
- 在三组测试集上准确率达0.89以上,显著优于传统模型与医生水平。
- 可辅助不同经验等级内镜医师,提升诊断准确率至0.87以上。
早期发现食管胃连接部腺癌(EGJA)对改善预后至关重要,但现有诊断高度依赖操作者。本文首次提出基于人工智能基础模型的EGJA筛查与分期诊断方法。研究在2016年12月28日至2024年12月30日期间,联合中国七家医院开展多中心队列研究,共收集1,546例患者的12,302张内镜图像:其中8,249张用于训练,其余分为保留测试集(112例,914张)、外部测试集(230例,1,539张)和前瞻性测试集(198例,1,600张)进行评估。所提模型结合DINOv2(视觉基础模型)与ResNet50(卷积神经网络),提取图像全局与局部特征以实现EGJA分期诊断。在三个测试集上,模型准确率分别为0.9256、0.8895、0.8956;相较之下,最佳对比模型(ResNet50)准确率为0.9125、0.8382、0.8519;专家内镜医师在保留测试集上准确率为0.8147。借助该模型,新手、熟练及专家医师的整体准确率分别从0.7035、0.7350、0.8147提升至0.8497、0.8521、0.8696。本研究为首个将基础模型应用于EGJA分期诊断的工作,展现出卓越的诊断精度与效率潜力。
原文摘要 · Abstract (English)
The early detection of esophagogastric junction adenocarcinoma (EGJA) is crucial for improving patient prognosis, yet its current diagnosis is highly operator-dependent. This paper aims to make the first attempt to develop an artificial intelligence (AI) foundation model-based method for both screening and staging diagnosis of EGJA using endoscopic images. In this cohort and learning study, we conducted a multicentre study across seven Chinese hospitals between December 28, 2016 and December 30, 2024. It comprises 12,302 images from 1,546 patients; 8,249 of them were employed for model training, while the remaining were divided into the held-out (112 patients, 914 images), external (230 patients, 1,539 images), and prospective (198 patients, 1,600 images) test sets for evaluation. The proposed model employs DINOv2 (a vision foundation model) and ResNet50 (a convolutional neural network) to extract features of global appearance and local details of endoscopic images for EGJA staging diagnosis. Our model demonstrates satisfactory performance for EGJA staging diagnosis across three test sets, achieving an accuracy of 0.9256, 0.8895, and 0.8956, respectively. In contrast, among representative AI models, the best one (ResNet50) achieves an accuracy of 0.9125, 0.8382, and 0.8519 on the three test sets, respectively; the expert endoscopists achieve an accuracy of 0.8147 on the held-out test set. Moreover, with the assistance of our model, the overall accuracy for the trainee, competent, and expert endoscopists improves from 0.7035, 0.7350, and 0.8147 to 0.8497, 0.8521, and 0.8696, respectively. To our knowledge, our model is the first application of foundation models for EGJA staging diagnosis and demonstrates great potential in both diagnostic accuracy and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。