arXiv:2511.12559cs.CV2025-11中稿 · AAAI被引 6

提出结构增强的专家混合对比学习框架,提升超声标准切面识别精度。

SEMC: Structure-Enhanced Mixture-of-Experts Contrastive Learning for Ultrasound Standard Plane Recognition

  • 融合多尺度结构信息,对齐浅层与深层特征提升细节感知。
  • 基于专家混合机制实现分层对比学习,显著提升类别可分性。
  • 构建6类肝超声标准切面的大规模标注数据集,适合医学影像研究者。

超声标准切面识别对疾病筛查、器官评估和生物测量等临床任务至关重要。现有方法难以有效利用浅层结构信息,且依赖图像增强生成的对比样本无法捕捉细微语义差异,导致对结构与判别性特征的识别效果不佳。为此,本文提出SEMC——一种结构增强的专家混合对比学习框架,结合结构感知特征融合与专家引导的对比学习。首先设计语义-结构融合模块(SSFM),通过有效对齐浅层与深层特征,增强模型对细粒度结构细节的感知能力。其次设计专家混合对比识别模块(MCRM),利用专家混合(MoE)机制在多层级特征上进行分层对比学习与分类,进一步提升类别可分性与识别性能。更重要的是,本文还构建了一个包含六种标准切面的大规模精细标注肝脏超声数据集。在自建数据集及两个公开数据集上的大量实验表明,SEMC在多种指标上均优于当前最先进方法。

原文摘要 · Abstract (English)

Ultrasound standard plane recognition is essential for clinical tasks such as disease screening, organ evaluation, and biometric measurement. However, existing methods fail to effectively exploit shallow structural information and struggle to capture fine-grained semantic differences through contrastive samples generated by image augmentations, ultimately resulting in suboptimal recognition of both structural and discriminative details in ultrasound standard planes. To address these issues, we propose SEMC, a novel Structure-Enhanced Mixture-of-Experts Contrastive learning framework that combines structure-aware feature fusion with expert-guided contrastive learning. Specifically, we first introduce a novel Semantic-Structure Fusion Module (SSFM) to exploit multi-scale structural information and enhance the model's ability to perceive fine-grained structural details by effectively aligning shallow and deep features. Then, a novel Mixture-of-Experts Contrastive Recognition Module (MCRM) is designed to perform hierarchical contrastive learning and classification across multi-level features using a mixture-of-experts (MoE) mechanism, further improving class separability and recognition performance. More importantly, we also curate a large-scale and meticulously annotated liver ultrasound dataset containing six standard planes. Extensive experimental results on our in-house dataset and two public datasets demonstrate that SEMC outperforms recent state-of-the-art methods across various metrics.

超声识别对比学习专家混合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。