首个结肠镜视频时序分割数据集与高效模型,助力自动化报告
A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentation
- 基于自定义时序卷积块,捕捉长时依赖关系
- 在60段视频270万帧上实现高精度分割,参数量低
- 开源数据集+跨中心验证,适合医疗视觉研究者
随着结肠镜辅助检测与诊断系统的发展,自动化结肠镜报告成为临床实践的突破口。然而,将完整结肠镜视频自动划分为解剖区域和操作阶段的计算机视觉模型仍处于探索阶段。本文首次构建公开可用的数据集,标注了60段完整结肠镜视频中的270万帧,涵盖九类解剖位置与操作阶段。提出ColonTCN模型,采用定制时序卷积模块,有效捕捉长时依赖。设计双k折交叉验证评估协议,包含多中心未见数据测试。ColonTCN在两种验证设置下均达最优分类准确率,参数量小。消融实验揭示任务挑战,验证模块有效性。该数据集与模型为结肠镜时序分割提供重要基准,推动开放研究。
原文摘要 · Abstract (English)
Following recent advancements in computer-aided detection and diagnosis systems for colonoscopy, the automated reporting of colonoscopy procedures is set to further revolutionize clinical practice. A crucial yet underexplored aspect in the development of these systems is the creation of computer vision models capable of autonomously segmenting full-procedure colonoscopy videos into anatomical sections and procedural phases. In this work, we aim to create the first open-access dataset for this task and propose a state-of-the-art approach, benchmarked against competitive models. We annotated the publicly available REAL-Colon dataset, consisting of 2.7 million frames from 60 complete colonoscopy videos, with frame-level labels for anatomical locations and colonoscopy phases across nine categories. We then present ColonTCN, a learning-based architecture that employs custom temporal convolutional blocks designed to efficiently capture long temporal dependencies for the temporal segmentation of colonoscopy videos. We also propose a dual k-fold cross-validation evaluation protocol for this benchmark, which includes model assessment on unseen, multi-center data.ColonTCN achieves state-of-the-art performance in classification accuracy while maintaining a low parameter count when evaluated using the two proposed k-fold cross-validation settings, outperforming competitive models. We report ablation studies to provide insights into the challenges of this task and highlight the benefits of the custom temporal convolutional blocks, which enhance learning and improve model efficiency. We believe that the proposed open-access benchmark and the ColonTCN approach represent a significant advancement in the temporal segmentation of colonoscopy procedures, fostering further open-access research to address this clinical need.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。