arXiv:2502.16709eess.IVcs.CV2025-02被引 1

用联邦学习+时空模型实现多中心心脏图像精准分割,保护患者隐私

FedDA-TSformer: Federated Domain Adaptation with Vision TimeSformer for Left Ventricle Segmentation on Gated Myocardial Perfusion SPECT Image

  • 结合时空注意力与联邦学习,从多中心数据中提取时空特征
  • 在三所医院150例数据上,心内膜和心外膜分割Dice值达0.842和0.907
  • 适合医疗影像多中心协作场景,兼顾精度与数据安全

背景与目的:基于门控心肌灌注(MPS)单光子发射计算机断层扫描的功能评估依赖于左心室轮廓的精确分割,同时需保障患者数据安全。方法:本文提出将联邦域适应与TimeSformer结合的FedDA-TSformer模型,用于MPS图像中的左心室分割。该模型通过空间注意力、时间注意力及联邦学习捕捉多中心MPS图像的时空特征,提升域适应能力并保障数据安全。具体采用分空间-时间-注意力机制提取多中心数据的时空相关性,确保预测时空一致性;通过局部最大均值差异(LMMD)损失对三个中心的模型输出进行域对齐,有效兼顾联邦学习与域适应需求,在多中心训练中提升性能的同时保护各医院数据隐私。结果:模型在三所医院共150名受试者的数据集上训练与评估,每例心脏周期分为8个时相。左心室心内膜与心外膜分割的骰子相似系数(DSC)分别达到0.842和0.907。结论:所提FedDA-TSformer模型解决了多中心泛化难题,保障了患者数据隐私,展现出在左心室分割中的有效性。

原文摘要 · Abstract (English)

Background and Purpose: Functional assessment of the left ventricle using gated myocardial perfusion (MPS) single-photon emission computed tomography relies on the precise extraction of the left ventricular contours while simultaneously ensuring the security of patient data. Methods: In this paper, we introduce the integration of Federated Domain Adaptation with TimeSformer, named 'FedDA-TSformer' for left ventricle segmentation using MPS. FedDA-TSformer captures spatial and temporal features in gated MPS images, leveraging spatial attention, temporal attention, and federated learning for improved domain adaptation while ensuring patient data security. In detail, we employed Divide-Space-Time-Attention mechanism to extract spatio-temporal correlations from the multi-centered MPS datasets, ensuring that predictions are spatio-temporally consistent. To achieve domain adaptation, we align the model output on MPS from three different centers using local maximum mean discrepancy (LMMD) loss. This approach effectively addresses the dual requirements of federated learning and domain adaptation, enhancing the model's performance during training with multi-site datasets while ensuring the protection of data from different hospitals. Results: Our FedDA-TSformer was trained and evaluated using MPS datasets collected from three hospitals, comprising a total of 150 subjects. Each subject's cardiac cycle was divided into eight gates. The model achieved Dice Similarity Coefficients (DSC) of 0.842 and 0.907 for left ventricular (LV) endocardium and epicardium segmentation, respectively. Conclusion: Our proposed FedDA-TSformer model addresses the challenge of multi-center generalization, ensures patient data privacy protection, and demonstrates effectiveness in left ventricular (LV) segmentation.

医学图像分割联邦学习时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。