用模拟环境优化探头姿态,实现低成本高精度手持超声三维成像。
Freehand 3D Ultrasound Imaging: Sim-in-the-Loop Probe Pose Optimization via Visual Servoing
- 通过仿真回路与视觉伺服控制,实时优化探头位置。
- 在三个测试模型上误差低于1.2毫米,精度优于传统方法。
- 适合临床场景中缺乏昂贵追踪设备的超声成像需求。
使用常规2D超声探头的手持3D超声成像具有灵活性和可及性,但面临探头位姿估计不准确的问题。传统方法依赖昂贵的追踪系统,而基于神经网络的方法易受图像噪声和误差累积影响,降低重建精度。本文提出一种低成本、通用性强的解决方案:利用轻量级摄像头与仿真环境中的视觉伺服控制,实现精确的3D超声成像。摄像头捕捉纹理平面工作区的视觉反馈,针对遮挡与光照问题,引入图像修复方法,通过匹配周围纹理模式重建遮挡区域。姿态估计采用“仿真-闭环”策略,在仿真中复现系统设置,迭代最小化仿真与真实观测间的位姿误差。视觉伺服控制器优化相机视图对齐,提升平移估计精度。在软血管假体、3D打印锥形模型和人体手臂上的验证显示,该方法鲁棒且精准,与参考重建的豪斯多夫距离分别为0.359毫米、1.171毫米和0.858毫米,证明其在可靠手持3D超声重建中的潜力。
原文摘要 · Abstract (English)
Freehand 3D ultrasound (US) imaging using conventional 2D probes offers flexibility and accessibility for diverse clinical applications but faces challenges in accurate probe pose estimation. Traditional methods depend on costly tracking systems, while neural network-based methods struggle with image noise and error accumulation, compromising reconstruction precision. We propose a cost-effective and versatile solution that leverages lightweight cameras and visual servoing in simulated environments for precise 3D US imaging. These cameras capture visual feedback from a textured planar workspace. To counter occlusions and lighting issues, we introduce an image restoration method that reconstructs occluded regions by matching surrounding texture patterns. For pose estimation, we develop a simulation-in-the-loop approach, which replicates the system setup in simulation and iteratively minimizes pose errors between simulated and real-world observations. A visual servoing controller refines the alignment of camera views, improving translational estimation by optimizing image alignment. Validations on a soft vascular phantom, a 3D-printed conical model, and a human arm demonstrate the robustness and accuracy of our approach, with Hausdorff distances to the reference reconstructions of 0.359 mm, 1.171 mm, and 0.858 mm, respectively. These results confirm the method's potential for reliable freehand 3D US reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。