arXiv:2603.29022cs.CV2026-03中稿 · MIDL 2026 / to app…被引 2

用物理模型生成更真实的超声新视角图像

UltraG-Ray: Physics-Based Gaussian Ray Casting for Novel Ultrasound View Synthesis

  • 基于可学习的3D高斯场,融合超声成像物理过程
  • 在MS-SSIM上提升15%,合成图像更接近真实超声
  • 适合医学影像生成与临床训练数据增强

超声新视角合成(NVS)可生成超出实际采集帧的解剖合理视图,为临床培训或数据增强提供新可能。但现有方法难以处理复杂组织及视角依赖的声学效应。物理基NVS通过将超声成像过程纳入仿真以解决此问题。近期方法结合可学习隐式场景表示与专用渲染模块,但仍存在仿真与现实间显著差距。本文提出UltraG-Ray,一种基于可学习3D高斯场的新型超声场景表示,搭配高效物理基B模式合成模块。显式编码衰减、反射等超声特异性参数至高斯空间表示,并在新颖的射线投射方案中实现图像合成。相比以往方法,该策略自然捕捉视角依赖衰减效应,从而生成更具物理一致性的真实感B模式图像。与最先进方法对比,我们在图像质量指标上持续提升(MS-SSIM最高提高15%),证实合成图像真实感显著增强。

原文摘要 · Abstract (English)

Novel view synthesis (NVS) in ultrasound has gained attention as a technique for generating anatomically plausible views beyond the acquired frames, offering new capabilities for training clinicians or data augmentation. However, current methods struggle with complex tissue and view-dependent acoustic effects. Physics-based NVS aims to address these limitations by including the ultrasound image formation process into the simulation. Recent approaches combine a learnable implicit scene representation with an ultrasound-specific rendering module, yet a substantial gap between simulation and reality remains. In this work, we introduce UltraG-Ray, a novel ultrasound scene representation based on a learnable 3D Gaussian field, coupled to an efficient physics-based module for B-mode synthesis. We explicitly encode ultrasound-specific parameters, such as attenuation and reflection, into a Gaussian-based spatial representation and realize image synthesis within a novel ray casting scheme. In contrast to previous methods, this approach naturally captures view-dependent attenuation effects, thereby enabling the generation of physically informed B-mode images with increased realism. We compare our method to state-of-the-art and observe consistent gains in image quality metrics (up to 15% increase on MS-SSIM), demonstrating clear improvement in terms of realism of the synthesized ultrasound images.

超声合成物理建模高斯表示图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。