首个膝关节镜手术阶段数据集与高效识别模型,助力手术智能化。
ArthroPhase: A Novel Dataset and Method for Phase Recognition in Arthroscopic Video
- 基于Transformer构建时空特征提取模型,融合视频帧与时间序列信息。
- 在ACL27数据集上准确率达72.91%,在Cholec80上达92.4%。
- 提出手术进展指数(SPI),误差仅10.6%,适合临床辅助与教学训练。
本研究针对膝关节镜前十字韧带重建手术,首次构建了包含27例手术视频的ACL27数据集,并提出一种基于Transformer的新型手术阶段识别方法。通过ResNet-50与Transformer层结合,实现时序感知的帧级特征提取,融合空间与时间信息,引入手术进展指数(Surgical Progress Index, SPI)量化手术进程。在ACL27和Cholec80数据集上评估,模型整体准确率分别达到72.91%和92.4%,SPI在两数据集上的输出误差分别为10.6%和9.86%。结果验证了方法的有效性与泛化能力,为手术培训、实时辅助与手术效率提升提供支持。公开的数据集与代码将推动该领域持续发展。
原文摘要 · Abstract (English)
This study aims to advance surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and developing a novel transformer-based model. We aim to establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address the specific challenges of arthroscopic videos including limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through a ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.91% on the ACL27 dataset. On the Cholec80 dataset, the model achieved a comparable performance with the state-of-the-art methods with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.86% on ACL27 and Cholec80 datasets respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and a robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research and development in this critical field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。