arXiv:2503.07799cs.CVcs.AI2025-03被引 3

无需标注数据,通过自监督学习和模型融合实现胎儿心脏病零样本检测。

Self-supervised Normality Learning and Divergence Vector-guided Model Merging for Zero-shot Congenital Heart Disease Detection in Fetal Ultrasound Videos

  • 基于自监督学习构建各医院独立的正常心音模型,避免数据共享。
  • 融合多中心模型后,在外部测试集上准确率提升23.77%,F1提升30.13%。
  • 适合医疗数据隐私要求高、标注稀缺的罕见病检测场景。

先天性心脏病(CHD)是胎儿死亡的主要原因之一,但受限于标注数据稀少及胎儿超声影像严格的隐私规定,基于深度学习的检测模型难以发展。集中式大规模真实数据集的收集需大量协调资源,且数据治理规则日益限制机构间的数据共享。为此,本文首次提出一种隐私保护的零样本CHD检测框架,将检测任务转化为正常性建模问题,并结合模型融合技术。该框架名为稀疏视频管自蒸馏(STUD),各医院站点在正常胎儿心脏超声片段上训练基于稀疏视频管的自监督异常检测模型,利用自蒸馏损失学习健康样本分布。为在不交换数据的前提下聚合跨中心知识,我们提出发散向量引导的模型融合方法(DivMerge),将各站点模型合并为单一异常检测模型。该方法保留了通用的时空表征,确保对未见CHD病例的泛化能力。我们在5家医院的真实胎儿超声数据上进行了评估,合并模型在外部测试集上的准确率和F1分数分别优于各站点模型23.77%和30.13%。

原文摘要 · Abstract (English)

Congenital Heart Disease (CHD) is one of the leading causes of fetal mortality, yet the scarcity of labeled CHD data and strict privacy regulations surrounding fetal ultrasound (US) imaging present significant challenges for the development of deep learning-based models for CHD detection. Centralised collection of large real-world datasets for rare conditions, such as CHD, from large populations requires significant co-ordination and resource. In addition, data governance rules increasingly prevent data sharing between sites. To address these challenges, we introduce, for the first time, a novel privacy-preserving, zero-shot CHD detection framework that formulates CHD detection as a normality modeling problem integrated with model merging. In our framework dubbed Sparse Tube Ultrasound Distillation (STUD), each hospital site first trains a sparse video tube-based self-supervised video anomaly detection (VAD) model on normal fetal heart US clips with self-distillation loss. This enables site-specific models to independently learn the distribution of healthy cases. To aggregate knowledge across the decentralized models while maintaining privacy, we propose a Divergence Vector-Guided Model Merging approach, DivMerge, that combines site-specific models into a single VAD model without data exchange. Our approach preserves domain-agnostic rich spatio-temporal representations, ensuring generalization to unseen CHD cases. We evaluated our approach on real-world fetal US data collected from 5 hospital sites. Our merged model outperformed site-specific models by 23.77% and 30.13% in accuracy and F1-score respectively on external test sets.

零样本检测自监督学习医疗影像模型融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。