arXiv:2506.15835eess.IVcs.AI2025-06被引 6

提升手绘3D超声重建精度,解决运动轨迹复杂时的累积误差问题。

MoNetV2: Enhanced Motion Network for Freehand 3D Ultrasound Reconstruction

  • 融合图像与运动信息,从速度角度优化帧间变换估计。
  • 引入多层级一致性约束,有效应对不同扫描速度和手法。
  • 自监督策略减少累积误差,提升模型泛化能力。

三维超声可提供解剖结构的空间关系,在临床诊断中至关重要。近年来,基于深度学习的手绘3D超声重建通过估计图像间变换实现体积重建,无需外部追踪设备。然而,仅依赖图像的重建方法在复杂运动轨迹下易产生累积漂移,影响精度。为此,本文提出增强型运动网络MoNetV2,以提升多样扫描速度与手法下的重建准确性和泛化能力。首先,设计基于传感器的时空多分支结构,从速度视角融合图像与运动信息,提升图像重建精度。其次,提出在线多层级一致性约束,利用扫描层面速度一致性、路径层面外观一致性及局部块级运动一致性,监督帧间变换估计。第三,构建在线多模态自监督策略,利用网络估计与运动信息的相关性进一步降低累积误差。大量实验表明,MoNetV2在三个大型数据集上均优于现有方法,在重建质量与泛化性能上表现卓越。

原文摘要 · Abstract (English)

Three-dimensional (3D) ultrasound (US) aims to provide sonographers with the spatial relationships of anatomical structures, playing a crucial role in clinical diagnosis. Recently, deep-learning-based freehand 3D US has made significant advancements. It reconstructs volumes by estimating transformations between images without external tracking. However, image-only reconstruction poses difficulties in reducing cumulative drift and further improving reconstruction accuracy, particularly in scenarios involving complex motion trajectories. In this context, we propose an enhanced motion network (MoNetV2) to enhance the accuracy and generalizability of reconstruction under diverse scanning velocities and tactics. First, we propose a sensor-based temporal and multi-branch structure that fuses image and motion information from a velocity perspective to improve image-only reconstruction accuracy. Second, we devise an online multi-level consistency constraint that exploits the inherent consistency of scans to handle various scanning velocities and tactics. This constraint exploits both scan-level velocity consistency, path-level appearance consistency, and patch-level motion consistency to supervise inter-frame transformation estimation. Third, we distill an online multi-modal self-supervised strategy that leverages the correlation between network estimation and motion information to further reduce cumulative errors. Extensive experiments clearly demonstrate that MoNetV2 surpasses existing methods in both reconstruction quality and generalizability performance across three large datasets.

3D超声运动建模自监督学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。