arXiv:2608.14763eess.IVcs.AI2026-08

用超声视频预测胎儿脑室体积,实现精准无创产前脑部筛查

Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screening

论文配图:Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screening
图 1 · 摘自论文原文
  • 基于超声视频的联合嵌入架构,利用时空一致性增强特征学习
  • 跨模态对齐使超声学得接近MRI的脑室体积信息,推理时仅需超声
  • 融合视觉-语言模型识别异常,适合产科医生快速筛查胎儿脑部问题

胎儿脑超声评估脑室扩大(VM)主要依赖标准切面测量侧脑室体部宽度,具有操作者依赖性,且无法全面反映整体脑室扩张。胎儿脑MRI可提供更可靠的体积信息,但成本高、难普及。为此,我们提出VIFBA——一种基于超声视频的胎儿脑评估框架,可预测MRI-derived侧脑室体积、分类VM严重程度,并识别潜在非VM脑部异常。贡献有三:首先,提出受JEPA启发的管状潜变量预测目标,利用超声视频时空一致性增强表示学习;其次,设计对比跨模态对齐策略,在训练中从MRI迁移结构信息,推理时仅需超声;第三,引入无需训练的视觉-语言模型与检索增强,验证不确定预测并发现潜在异常。在包含857例(3,196段视频)配对超声与MRI数据的大规模数据集上验证,测试集上脑室体积回归的平均绝对误差为0.5909 mL,皮尔逊相关系数达0.9907,VM严重程度分类准确率为0.9400,多异常分类F1得分为0.7764,显著优于单任务基线、视频强基线及当前最优基础模型。该方法仅通过常规超声即可实现近似MRI的体积评估,为精准、低成本产前脑部筛查提供了实用可行路径。

原文摘要 · Abstract (English)

Assessment of ventriculomegaly (VM) on fetal brain ultrasound relies primarily on measuring lateral ventricular atrial width on standard planes, which is operator-dependent and may not fully reflect the overall ventricular enlargement. Fetal brain MRI provides more reliable volumetric information but is costly and less accessible for routine use. To address these limitations, we propose VIFBA, an ultrasound video-based framework for fetal brain assessment that predicts MRI-derived lateral ventricular volume, classifies VM severity, and identifies potential non-VM fetal brain abnormalities. Our contribution is three-fold. First, we introduce a joint-embedding predictive architecture (JEPA)-inspired tube latent prediction objective that leverages spatio-temporal coherence in ultrasound videos to enhance representation learning. Second, we develop a contrastive cross-modal alignment strategy that transfers structural information from MRI to ultrasound during training, while requiring ultrasound alone at inference. Third, we augment VIFBA with a training-free vision-language model and retrieval augmentation to verify uncertain predictions and identify potential non-VM fetal brain abnormalities. We validated VIFBA on a large dataset comprising 857 cases (3,196 videos) with paired fetal brain ultrasound and MRI examinations. On held-out test data, VIFBA achieved an MAE of 0.5909 mL and Pearson correlation coefficient of 0.9907 for ventricular volume regression, 0.9400 accuracy for VM severity classification, and an F1 score of 0.7764 for multi-abnormality classification, substantially outperforming single-task baselines, video-based strong competitors, and state-of-the-art foundation models. By enabling MRI-informed volumetric assessment from routine ultrasound alone, VIFBA offers a practical and potentially broadly deployable pathway toward accurate and affordable prenatal brain screening.

胎儿超声跨模态学习脑室体积产前筛查

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。