用视觉数据自动指导远程超声探头初始定位,提升无专家在场时的检查效率。
Towards Automated Initial Probe Placement in Transthoracic Teleultrasound Using Human Mesh and Skeleton Recovery
- 通过摄像头与深度点云重建患者体表和骨骼模型,实现无需训练的人体注册。
- 基于骨骼关键点预测肋间隙位置,将探头引导信息投影回3D体表,误差均值15mm。
- 适用于远程超声场景,尤其适合缺乏经验的操作者快速准确放置探头。
心脏和肺部超声操作难度高,需识别患者特异性的肋间声窗,并通过调整探头位置、角度和力度在不同成像平面间切换。这一挑战在远程超声中尤为突出:一旦探头大致就位,专家可在图像空间导航,但远程指导初始放置因患者三维感知受限而困难。本文提出一种框架,利用校准摄像头获取的RGB图像和深度图像累积的点云,自动化完成患者注册与解剖引导的初始探头放置(PIPG)。初学者通过混合现实(MR)头戴设备拍摄患者,边缘服务器推断出个体化的体表与骨骼模型。借助多视角与点云数据的空间-时间一致性,实现无需训练的鲁棒人体注册,已在医疗环境中验证。基于预测骨骼的骨性标志点,估计肋间隙区域,并将引导信息投影回重构体表。为验证框架,我们在现场多个经胸超声扫描平面中,在MR头显上渲染重构体表与虚拟探头引导,并测量放置误差。五名健康志愿者的初步实验表明,所提探头定位预测与MR引导可实现一致的初始放置,表面误差均值15 mm,相对于可触诊解剖标志的位置误差为41.0 mm,躯干姿态误差小于9度,符合远程超声应用要求。
原文摘要 · Abstract (English)
Cardiac and lung ultrasound are technically demanding because operators must identify patient-specific intercostal acoustic windows and then navigate between standard views by adjusting probe position, rotation, and force across different imaging planes. These challenges are amplified in teleultrasound, where the examination proceeds without in-person expert assistance: once the probe is approximately positioned, the expert can navigate in ultrasound image space, but guiding the initial placement remotely remains difficult given the limited 3D perception of the patient. We present a framework for automating patient registration and anatomy-informed initial probe placement guidance (PIPG) using RGB images obtained from a calibrated camera and a point cloud accumulated from depth images. The novice first captures the patient using the camera on a mixed reality (MR) head-mounted display (HMD), and an edge server then infers a patient-specific body-surface and skeleton model. By leveraging the patient's spatial and temporal consistency across multiview and point cloud data, we achieved robust, training-free human registration, verified in a healthcare setting. Using bony landmarks from the predicted skeleton, we estimate the intercostal region and project the guidance back onto the reconstructed body surface. To validate the framework, we rendered the reconstructed body mesh and the virtual probe pose guidance in the MR headset across multiple transthoracic echocardiography scan planes in situ and measured the quantitative placement error. Pilot experiments with five healthy volunteers suggest that the proposed probe placement prediction and MR guidance yield consistent initial placement, with a mean surface error of 15 mm, positional error to palpated anatomical landmarks of 41.0 mm, and torso orientation errors within 9 deg, acceptable for the teleultrasound setup.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。