arXiv:2502.08988cs.CV2025-02

用嵌套潜空间提升小数据下超声心动图分割精度

Latents of latents to delineate pixels: hybrid Matryoshka autoencoder-to-U-Net pairing for segmenting large medical images in GPU-poor and low-data regimes

  • 设计嵌套自编码器与U-Net结合的分层架构,保留图像细节
  • 在斯坦福超声数据集上实现86.91%的Dice系数,优于基线模型
  • 适合资源受限和标注数据少的医学图像分割场景

医学图像通常分辨率高,下采样会丢失关键细节,导致像素级分割效率降低。本文提出一种低秩嵌套投影方法与混合分割架构,在保持重要信息的同时保留足够的像素几何结构。设计了将嵌套自编码器的层次编码与U-Net解码器的空间重建能力结合的MatAE-U-Net模型,利用多尺度特征提取与跳跃连接提升准确率与泛化能力。在斯坦福EchoNet-D数据集上对心脏超声视频(1,000对标准化视频-掩码,112×112像素)进行左心室分割,模型取得77.68%的均值IoU、97.46%的均值像素精度与86.91%的Dice系数,优于基线U-Net(74.70% IoU,97.31%精度,85.20% Dice系数)。结果表明,将U-Net应用于嵌套潜空间对低对比度医学图像分析具有潜力。

原文摘要 · Abstract (English)

Medical images are often high-resolution and lose important detail if downsampled, making pixel-level methods such as semantic segmentation much less efficient if performed on a low-dimensional image. We propose a low-rank Matryoshka projection and a hybrid segmenting architecture that preserves important information while retaining sufficient pixel geometry for pixel-level tasks. We design the Matryoshka Autoencoder (MatAE-U-Net) which combines the hierarchical encoding of the Matryoshka Autoencoder with the spatial reconstruction capabilities of a U-Net decoder, leveraging multi-scale feature extraction and skip connections to enhance accuracy and generalisation. We apply it to the problem of segmenting the left ventricle (LV) in echocardiographic images using the Stanford EchoNet-D dataset, including 1,000 standardised video-mask pairs of cardiac ultrasound videos resized to 112x112 pixels. The MatAE-UNet model achieves a Mean IoU of 77.68\%, Mean Pixel Accuracy of 97.46\%, and Dice Coefficient of 86.91\%, outperforming the baseline U-Net, which attains a Mean IoU of 74.70\%, Mean Pixel Accuracy of 97.31\%, and Dice Coefficient of 85.20\%. The results highlight the potential of using the U-Net in the recursive Matroshka latent space for imaging problems with low-contrast such as echocardiographic analysis.

医学图像分割嵌套潜空间小样本学习超声心动图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。