用AI自动调节显微镜视野，让新手操作速度媲美专家
Automatic Field-of-View Adjustment for a View-Expansive Microscope via LSTM-Based Gaze and Pipette Motion Interpretation
- 通过LSTM模型分析操作者视线和注射针位置，预测最佳视野大小
- 实验显示新手操作时间从60.5秒缩短至48.0秒，显著提升效率
- 适合辅助生殖医疗中需要高精度微操作的场景
卵胞质内单精子注射（ICSI）操作中，医生频繁调整视野会中断流程并延长手术时间。传统显微镜需手动更换物镜和调节光照以切换视野范围。本文提出一种基于AI的自动视野调节方法，集成于可拓展视野显微镜。该显微镜通过高速视觉与激光反射镜阵列实现单物镜下大视野与高分辨率图像同步获取，无需物理换镜。我们采用长短期记忆（LSTM）模型，根据实时注射针位置、速度及操作者视线位置预测合适视野尺寸。模型基于一位五年经验以上专家的操作数据训练。对新手操作者的实验评估显示，该系统显著提升手术效率，平均任务完成时间由60.5秒降至48.0秒（p < 0.001），且使新手操作速度达到专家水平。
原文摘要 · Abstract (English)
Intracytoplasmic sperm injection (ICSI) operators frequently adjust the field-of-view (FOV) during procedures, which interrupts workflow and increases procedure time. Conventional microscopes require manual objective lens switching and illumination adjustments to achieve different FOV sizes. We propose an AI-based automatic FOV adjustment method integrated with a view-expansive microscope. This microscope enables the simultaneous acquisition of a large FOV and high-resolution images using a single objective lens through multiview imaging with galvanometer mirrors and high-speed vision, thereby eliminating the need for physical lens exchanges. Our method utilizes a long short-term memory (LSTM) model to predict the appropriate FOV size based on real-time analysis of the pipette's position and velocity, combined with the operator's gaze position. The AI model is trained using ICSI procedure data from an expert with over five years of micromanipulation experience. Experimental evaluation with novice operators reveals that the proposed automatic FOV adjustment system significantly improves the ICSI procedure speed, reducing the average task completion time from 60.5 to 48.0 s (p < 0.001). The experiments also demonstrate that this improvement enables novice operators to achieve ICSI working speeds equivalent to those of expert operators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。