提升手术中激光束定位精度,让荧光成像更实时可靠
Data-Centric Learning Framework for Real-Time Detection of Aiming Beam in Fluorescence Lifetime Imaging Guided Surgery
- 用数据驱动方法优化激光束实例分割模型,减少标注噪声
- 在40段真实手术视频上实现85%的检测率,临床测试也达85%
- 每秒处理24帧,满足手术实时性需求,适合复杂环境应用
本研究提出一种新型数据驱动方法,用于提升基于光纤的荧光寿命成像(FLIm)在手术中的实时引导能力。关键挑战在于复杂多变的手术环境下准确检测瞄准激光束,尤其在经口机器人手术(TORS)中,光照不均导致反射、对比度下降和色彩失真,影响检测效果。为此,采用数据驱动的训练策略构建实例分割模型,有效降低标签噪声并增强鲁棒性。在包含40段活体手术视频的数据集上评估,模型中位检测率达85%;集成至临床系统后,在患者TORS手术中仍保持85%的检测率。系统计算效率约24帧/秒,满足实时手术引导要求。该研究显著提升了复杂手术环境中FLIm引导下瞄准束检测的可靠性,推动实时影像引导手术的临床可行性。
原文摘要 · Abstract (English)
This study introduces a novel data-centric approach to improve real-time surgical guidance using fiber-based fluorescence lifetime imaging (FLIm). A key aspect of the methodology is the accurate detection of the aiming beam, which is essential for localizing points used to map FLIm measurements onto the tissue region within the surgical field. The primary challenge arises from the complex and variable conditions encountered in the surgical environment, particularly in Transoral Robotic Surgery (TORS). Uneven illumination in the surgical field can cause reflections, reduce contrast, and results in inconsistent color representation, further complicating aiming beam detection. To overcome these challenges, an instance segmentation model was developed using a data-centric training strategy that improves accuracy by minimizing label noise and enhancing detection robustness. The model was evaluated on a dataset comprising 40 in vivo surgical videos, demonstrating a median detection rate of 85%. This performance was maintained when the model was integrated in a clinical system, achieving a similar detection rate of 85% during TORS procedures conducted in patients. The system's computational efficiency, measured at approximately 24 frames per second (FPS), was sufficient for real-time surgical guidance. This study enhances the reliability of FLIm-based aiming beam detection in complex surgical environments, advancing the feasibility of real-time, image-guided interventions for improved surgical precision
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。