用AI自动分析显微吻合术操作,实现精准评分与实时反馈。
Kinematic-Based Assessment of Surgical Actions in Microanastomosis
- 基于YOLO和DeepSORT追踪器械尖端,结合自相似矩阵分割手术动作。
- 在58段视频上达到92.4%动作分割准确率,85.5%技能评估准确率。
- 适合需要客观训练评价的神经外科教学与手术能力考核场景。
显微吻合术是神经外科关键技能,要求精确操控细小器械,依赖持续专注、协调手部动作及高度精细的运动能力。传统评估依赖专家现场观察或视频回放,存在主观性强、评分不一致且耗时等问题。为此,本文提出一种面向边缘计算平台的AI驱动框架,用于显微吻合术的自动化动作分割与绩效评估。系统包含三部分:(1) 基于YOLO与DeepSORT的器械尖端追踪与定位模块;(2) 利用自相似矩阵检测动作边界并进行无监督聚类的动作分割模块;(3) 用于评估手术动作熟练度的监督分类模块。在58段经专家评分的显微吻合术视频上验证,该方法实现92.4%的帧级动作分割准确率和85.5%的整体技能分类准确率,可复现专家评估结果。本方法为显微外科教育提供客观、实时反馈,推动高风险手术环境中标准化、数据驱动的培训体系发展。
原文摘要 · Abstract (English)
Proficiency in microanastomosis is a critical surgical skill in neurosurgery, where the ability to precisely manipulate fine instruments is crucial to successful outcomes. These procedures require sustained attention, coordinated hand movements, and highly refined motor skills, underscoring the need for objective and systematic methods to evaluate and enhance microsurgical training. Conventional assessment approaches typically rely on expert raters supervising the procedures or reviewing surgical videos, which is an inherently subjective process prone to inter-rater variability, inconsistency, and significant time investment. These limitations highlight the necessity for automated and scalable solutions. To address this challenge, we introduce a novel AI-driven framework for automated action segmentation and performance assessment in microanastomosis procedures, designed to operate efficiently on edge computing platforms. The proposed system comprises three main components: (1) an object tip tracking and localization module based on YOLO and DeepSORT; (2) an action segmentation module leveraging self-similarity matrix for action boundary detection and unsupervised clustering; and (3) a supervised classification module designed to evaluate surgical gesture proficiency. Experimental validation on a dataset of 58 expert-rated microanastomosis videos demonstrates the effectiveness of our approach, achieving a frame-level action segmentation accuracy of 92.4% and an overall skill classification accuracy of 85.5% in replicating expert evaluations. These findings demonstrate the potential of the proposed method to provide objective, real-time feedback in microsurgical education, thereby enabling more standardized, data-driven training protocols and advancing competency assessment in high-stakes surgical environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。