通过渐进式冻结微调,用少量标注数据提升腹腔镜手术工具检测精度。
Adaptive transfer learning for surgical tool presence detection in laparoscopic videos through gradual freezing fine-tuning
- 分两阶段微调:先线性探测,再逐步冻结底层参数。
- 在Cholec80数据集上达到96.4%的mAP,优于现有方法。
- 仅需一次训练,适合标注少的医疗视觉任务。
微创手术可显著受益于自动化手术工具检测,实现高级分析与辅助。然而,手术场景中注释数据有限,制约了深度学习模型的鲁棒性训练。本文提出一种新型分阶段自适应微调方法,包含两个步骤:首先在线性探测阶段将额外分类层适配到预训练的CNN架构,再通过渐进式冻结阶段动态减少可微调层,以调控对手术领域的适应能力。该策略降低网络复杂度,提升效率,仅需一次训练循环,无需多次迭代。我们在Cholec80数据集上验证了该方法,采用在ImageNet上预训练的ResNet-50和DenseNet-121模型,检测胆囊切除术内窥镜视频中的手术工具。结果表明,本方法在检测性能上优于现有技术及标准微调策略,达到96.4%的平均精度(mAP)。为进一步验证其泛化能力,该微调策略在另一类微创眼科手术数据集CATARACTS上也表现良好。研究显示,渐进式冻结微调是一种提升多样化手术流程中工具存在检测的有前景技术,可能在通用图像分类任务中具有更广泛应用。
原文摘要 · Abstract (English)
Minimally invasive surgery can benefit significantly from automated surgical tool detection, enabling advanced analysis and assistance. However, the limited availability of annotated data in surgical settings poses a challenge for training robust deep learning models. This paper introduces a novel staged adaptive fine-tuning approach consisting of two steps: a linear probing stage to condition additional classification layers on a pre-trained CNN-based architecture and a gradual freezing stage to dynamically reduce the fine-tunable layers, aiming to regulate adaptation to the surgical domain. This strategy reduces network complexity and improves efficiency, requiring only a single training loop and eliminating the need for multiple iterations. We validated our method on the Cholec80 dataset, employing CNN architectures (ResNet-50 and DenseNet-121) pre-trained on ImageNet for detecting surgical tools in cholecystectomy endoscopic videos. Our results demonstrate that our method improves detection performance compared to existing approaches and established fine-tuning techniques, achieving a mean average precision (mAP) of 96.4%. To assess its broader applicability, the generalizability of the fine-tuning strategy was further confirmed on the CATARACTS dataset, a distinct domain of minimally invasive ophthalmic surgery. These findings suggest that gradual freezing fine-tuning is a promising technique for improving tool presence detection in diverse surgical procedures and may have broader applications in general image classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。