arXiv:2606.18825cs.CV2026-06被引 3

用信念更新框架提升2D-3D超声实时配准精度

DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration

论文配图:DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration
图 1 · 摘自论文原文
  • 构建基于信念的状态,持续融合新图像与探头位置信息
  • 在CAMUS和u-RegPro数据集上达到领先配准精度与鲁棒性
  • 适合需要实时反馈的术中导航场景,尤其应对噪声与不完整观测

超声成像广泛用于手术导航,但术中2D切片与术前3D体积的实时配准仍面临部分可观测性、斑点噪声及探头运动依赖性采集等挑战。现有方法多为一次性或短时程,难以积累时间证据,也难捕捉外科医生根据屏幕反馈调整探头动作的行为。本文提出DreamReg,一种基于信念驱动的世界模型框架,将2D-3D配准建模为刚体变换的信念更新过程。该框架维护一个潜在信念状态,整合历史观测与姿态信息,并随新切片到来持续优化变换。训练时,模型通过模拟临床扫描轨迹学习如何根据当前超声观测条件化姿态修正;推理时,通过内部想象:滚动学习到的世界模型以模拟候选探头运动及其预测观测,再融合这些想象结果收敛至准确刚体变换。在CAMUS和u-RegPro数据集上的实验表明,相比现有最优方法,DreamReg在实时引导中展现出更优的鲁棒性和竞争性配准精度。

原文摘要 · Abstract (English)

Ultrasound (US) is widely used for surgical navigation, yet real-time registration between intraoperative 2D slices and preoperative 3D volumes remains challenging due to partial observability, speckle noise, and the action-dependent US acquisition. Existing methods are one-shot or short-horizon, making it hard for them to gather evidence over time or capture how surgeons adjust probe motion based on on-screen feedback. We propose DreamReg, a belief-driven world-model framework that formulates 2D-3D registration as belief updating over rigid transformations. DreamReg maintains a latent belief state that summarizes past observations and poses information, and continuously refines the transformation through learned dynamics as new slices arrive. During training, DreamReg is exposed to probe-motion trajectories that mimic clinical scanning behavior and learns to update its belief by conditioning pose refinement on the current US observation. During inference, DreamReg refines registration via internal imagination: it rolls out the learned world model to simulate candidate probe motions and their predicted observations, and integrates these imagined outcomes to converge to an accurate rigid transformation. Experiments on CAMUS and u-RegPro datasets demonstrate improved robustness and competitive registration accuracy for real-time guidance compared with state-of-the-art methods.

超声配准世界模型信念更新手术导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。