arXiv:2509.08991cs.CV2025-09被引 2

用声学特征提升超声3D重建,弱监督下更准更鲁棒。

UltrON: Ultrasound Occupancy Networks

  • 基于声学特征的占用网络,不依赖精细标注。
  • 新损失函数缓解视角依赖与阴影伪影问题。
  • 适合临床医生做超声3D建模,尤其标注少时

自由手持超声成像中,超声医师需凭经验将局部2D图像拼合成3D解剖结构。形状重建可辅助该过程。核心挑战在于形状表示的选择,它决定了可视化、分析与解读的精度与效率。隐式表示(如SDF和占用函数)通过紧凑存储实现连续平滑表面建模,避免显式离散化,优于传统体素或网格方法。近期研究证明,可利用分割后的B-mode图像标注优化SDF。然而这些方法依赖精确标注,忽视了B-mode强度中蕴含的丰富声学信息。此外,隐式方法对超声的视图依赖性及声影伪影敏感,影响重建质量。为解决遮挡与标注依赖问题,本文提出基于占用的表示方法,引入 extit{UltrON},利用无需额外标注的B-mode图像中的声学特征,提升弱监督优化下的几何一致性。我们设计了一种新型损失函数,补偿B-mode图像的视图依赖性,支持多视角超声的占用优化。通过融合声学特性, extit{UltrON}可泛化至同类型解剖结构。结果表明, extit{UltrON}有效缓解遮挡与稀疏标注带来的限制,推动更精准的3D重建。代码与数据集将在https://github.com/magdalena-wysocki/ultron发布。

原文摘要 · Abstract (English)

In free-hand ultrasound imaging, sonographers rely on expertise to mentally integrate partial 2D views into 3D anatomical shapes. Shape reconstruction can assist clinicians in this process. Central to this task is the choice of shape representation, as it determines how accurately and efficiently the structure can be visualized, analyzed, and interpreted. Implicit representations, such as SDF and occupancy function, offer a powerful alternative to traditional voxel- or mesh-based methods by modeling continuous, smooth surfaces with compact storage, avoiding explicit discretization. Recent studies demonstrate that SDF can be effectively optimized using annotations derived from segmented B-mode ultrasound images. Yet, these approaches hinge on precise annotations, overlooking the rich acoustic information embedded in B-mode intensity. Moreover, implicit representation approaches struggle with the ultrasound's view-dependent nature and acoustic shadowing artifacts, which impair reconstruction. To address the problems resulting from occlusions and annotation dependency, we propose an occupancy-based representation and introduce \gls{UltrON} that leverages acoustic features to improve geometric consistency in weakly-supervised optimization regime. We show that these features can be obtained from B-mode images without additional annotation cost. Moreover, we propose a novel loss function that compensates for view-dependency in the B-mode images and facilitates occupancy optimization from multiview ultrasound. By incorporating acoustic properties, \gls{UltrON} generalizes to shapes of the same anatomy. We show that \gls{UltrON} mitigates the limitations of occlusions and sparse labeling and paves the way for more accurate 3D reconstruction. Code and dataset will be available at https://github.com/magdalena-wysocki/ultron.

超声成像隐式表示弱监督3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。