混合现实系统让医学生在无导师情况下精准训练接生,提升操作能力。
A Mixed Reality System for Robust Manikin Localization in Childbirth Training
- 用外部摄像头校准头显,实现物理模型与虚拟指导手的实时融合
- 通过粗到精定位,使虚拟引导手在真实产模附近精确对齐
- 83名医学生实测显示,混合现实训练效果优于纯虚拟现实
医学生接受阴道分娩实践的机会因临床轮转缩短、患者抗拒及产程不可预测而日益受限。为减轻导师负担并提升学习效率,我们提出一种混合现实(MR)分娩训练系统,结合虚拟指引与实体模型触觉交互,在保留真实触感的同时支持独立练习,无需持续现场专家监督。系统通过空间校准外置RGB-D相机,扩展商用头戴设备的透视功能,实现实时融合物理训练对象。在此基础上,构建从粗到精的定位流程:先利用标记点对齐产妇模型以划定分娩区域,再将预扫描的新生儿头部注册至该区域内。该过程可实现虚拟引导手在模型附近的精准叠加,使学员能通过触觉反馈跟随专家操作轨迹。实验评估表明,系统在独立头显上实现了准确稳定的模型定位,适合无外部计算资源部署。随后开展大规模用户研究,83名四年级医学生参与比较MR与虚拟现实(VR)训练。四位资深妇产科医生基于标准评分体系独立评估表现。结果显示,MR训练在分娩、产后及总体任务表现上得分显著更高,且受试者普遍更偏好该方式。
原文摘要 · Abstract (English)
Opportunities for medical students to gain practical experience in vaginal births are increasingly constrained by shortened clinical rotations, patient reluctance, and the unpredictable nature of labour. To alleviate clinicians' instructional burden and enhance trainees' learning efficiency, we introduce a mixed reality (MR) system for childbirth training that combines virtual guidance with tactile manikin interaction, thereby preserving authentic haptic feedback while enabling independent practice without continuous on-site expert supervision. The system extends the passthrough capability of commercial head-mounted displays (HMDs) by spatially calibrating an external RGB-D camera, allowing real-time visual integration of physical training objects. Building on this capability, we implement a coarse-to-fine localization pipeline that first aligns the maternal manikin with fiducial markers to define a delivery region and then registers the pre-scanned neonatal head within this area. This process enables spatially accurate overlay of virtual guiding hands near the manikin, allowing trainees to follow expert trajectories reinforced by haptic interaction. Experimental evaluations demonstrate that the system achieves accurate and stable manikin localization on a standalone headset, ensuring practical deployment without external computing resources. A large-scale user study involving 83 fourth-year medical students was subsequently conducted to compare MR-based and virtual reality (VR)-based childbirth training. Four senior obstetricians independently assessed performance using standardized criteria. Results showed that MR training achieved significantly higher scores in delivery, post-delivery, and overall task performance, and was consistently preferred by trainees over VR training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。