arXiv:2412.16195cs.CVcs.AI2024-12被引 6

用AI自动分析腹腔镜缝合技能,无需人工标注工具轨迹。

Machine Learning-Based Automated Assessment of Intracorporeal Suturing in Laparoscopic Fundoplication

  • 基于SAM模型实现无标注的手术工具自动追踪。
  • 无监督1D-CNN模型准确率达81.7%,超越传统特征方法。
  • 适合医学教育中实时评估外科手术训练水平。

利用人工智能自动评估外科手术技能可为培训者提供即时反馈。在采集双手器械运动数据后,提取的运动学指标可有效预测腹腔镜操作表现。传统工具追踪需耗时的人工标注,本研究采用基于Segment Anything Model(SAM)的AI模型,实现无需人工标注的自动化工具追踪。研究评估该模型在猪肠部腹腔镜胃底折叠术缝合任务中的应用效果。28名参与者(9名新手,19名专家)的手术视频被分析,通过分割缝合步骤并提取左右器械运动数据,使用24Hz低通滤波去噪。性能评估采用监督与非监督学习模型,并进行消融实验。提取的运动学特征包括均方根速度、加速度、加速度变化率、总路径长度及双侧灵巧性指数,分别用逻辑回归、随机森林、支持向量机和XGBoost建模;主成分分析用于降维。非监督学习中,采用去噪自编码器(DAE)结合1维卷积神经网络等分类器。结果显示,经PCA处理的随机森林监督模型准确率为0.795,F1得分为0.778;而无监督1维卷积神经网络模型准确率达0.817,F1得分为0.806,且无需计算运动学特征。证明了该AI模型可独立于人工标注完成手术表现自动分类。

原文摘要 · Abstract (English)

Automated assessment of surgical skills using artificial intelligence (AI) provides trainees with instantaneous feedback. After bimanual tool motions are captured, derived kinematic metrics are reliable predictors of performance in laparoscopic tasks. Implementing automated tool tracking requires time-intensive human annotation. We developed AI-based tool tracking using the Segment Anything Model (SAM) to eliminate the need for human annotators. Here, we describe a study evaluating the usefulness of our tool tracking model in automated assessment during a laparoscopic suturing task in the fundoplication procedure. An automated tool tracking model was applied to recorded videos of Nissen fundoplication on porcine bowel. Surgeons were grouped as novices (PGY1-2) and experts (PGY3-5, attendings). The beginning and end of each suturing step were segmented, and motions of the left and right tools were extracted. A low-pass filter with a 24 Hz cut-off frequency removed noise. Performance was assessed using supervised and unsupervised models, and an ablation study compared results. Kinematic features--RMS velocity, RMS acceleration, RMS jerk, total path length, and Bimanual Dexterity--were extracted and analyzed using Logistic Regression, Random Forest, Support Vector Classifier, and XGBoost. PCA was performed for feature reduction. For unsupervised learning, a Denoising Autoencoder (DAE) model with classifiers, such as a 1-D CNN and traditional models, was trained. Data were extracted for 28 participants (9 novices, 19 experts). Supervised learning with PCA and Random Forest achieved an accuracy of 0.795 and an F1 score of 0.778. The unsupervised 1-D CNN achieved superior results with an accuracy of 0.817 and an F1 score of 0.806, eliminating the need for kinematic feature computation. We demonstrated an AI model capable of automated performance classification, independent of human annotation.

AI医疗手术评估机器学习自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。