联邦学习训练血管手术影像基础模型,解决数据隐私与标注不足难题。
FedEFM: Federated Endovascular Foundation Model with Unseen Data
- 基于可微地球移动距离的联邦知识蒸馏,应对未见过的数据挑战。
- 在3个真实血管手术数据集上实现新最好性能,分割精度提升显著。
- 适合医疗影像、联邦学习与机器人辅助手术方向的研究者参考。
在血管内手术中,精准识别X射线图像中的导管和导丝对降低干预风险至关重要。然而,由于标注数据有限,准确分割导管和导丝结构极具挑战。基础模型可通过收集相似领域数据训练,其权重可用于下游任务微调,提供有效解决方案。但大规模数据收集受限于患者隐私保护需求。本文提出一种在去中心化联邦学习框架下训练血管内介入基础模型的新方法。为确保训练可行性,我们采用可微地球移动距离(dEMD)嵌入知识蒸馏框架,以应对未见数据问题。模型训练完成后,其权重可作为下游任务的良好初始化,显著提升特定任务性能。大量实验表明,本方法在3个真实血管手术数据集上达到新的最先进水平,推动了血管内介入与机器人辅助手术的发展,同时有效解决医疗领域数据共享的关键难题。
原文摘要 · Abstract (English)
In endovascular surgery, the precise identification of catheters and guidewires in X-ray images is essential for reducing intervention risks. However, accurately segmenting catheter and guidewire structures is challenging due to the limited availability of labeled data. Foundation models offer a promising solution by enabling the collection of similar domain data to train models whose weights can be fine-tuned for downstream tasks. Nonetheless, large-scale data collection for training is constrained by the necessity of maintaining patient privacy. This paper proposes a new method to train a foundation model in a decentralized federated learning setting for endovascular intervention. To ensure the feasibility of the training, we tackle the unseen data issue using differentiable Earth Mover's Distance within a knowledge distillation framework. Once trained, our foundation model's weights provide valuable initialization for downstream tasks, thereby enhancing task-specific performance. Intensive experiments show that our approach achieves new state-of-the-art results, contributing to advancements in endovascular intervention and robotic-assisted endovascular surgery, while addressing the critical issue of data sharing in the medical domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。