用联邦学习训练胃镜影像基础模型,保护隐私同时提升诊断效果。
Federated Foundation Model for GI Endoscopy Images
- 通过联邦学习让医院本地数据参与训练,不共享原始数据
- 在分类、检测、分割任务上均优于传统方法
- 适合医疗数据隐私要求高的场景,如医院联合建模
胃肠镜检查对早期发现消化道疾病至关重要。尽管深度学习在辅助诊断中表现优异,但其依赖标注数据,而医学数据标注成本高昂。基础模型可通过通用表征学习,经微调后适应具体任务,缓解数据稀缺问题。然而,医疗数据敏感性强,隐私限制阻碍了数据共享,使基础模型训练难以实现。本文提出一种面向胃镜影像的基础模型联邦学习框架,使数据保留在本地医院,同时协同训练共享模型。我们评估了多种经典联邦算法在无任务标签情况下的适用性,在同质与异质设置下开展实验。在分类、检测和分割三个关键下游任务上验证模型性能,结果表明该方法在保护隐私的前提下显著提升各类任务表现,证明了其有效性。
原文摘要 · Abstract (English)
Gastrointestinal (GI) endoscopy is essential in identifying GI tract abnormalities in order to detect diseases in their early stages and improve patient outcomes. Although deep learning has shown success in supporting GI diagnostics and decision-making, these models require curated datasets with labels that are expensive to acquire. Foundation models offer a promising solution by learning general-purpose representations, which can be finetuned for specific tasks, overcoming data scarcity. Developing foundation models for medical imaging holds significant potential, but the sensitive and protected nature of medical data presents unique challenges. Foundation model training typically requires extensive datasets, and while hospitals generate large volumes of data, privacy restrictions prevent direct data sharing, making foundation model training infeasible in most scenarios. In this work, we propose a FL framework for training foundation models for gastroendoscopy imaging, enabling data to remain within local hospital environments while contributing to a shared model. We explore several established FL algorithms, assessing their suitability for training foundation models without relying on task-specific labels, conducting experiments in both homogeneous and heterogeneous settings. We evaluate the trained foundation model on three critical downstream tasks--classification, detection, and segmentation--and demonstrate that it achieves improved performance across all tasks, highlighting the effectiveness of our approach in a federated, privacy-preserving setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。