引入时间感知对比学习,提升结肠镜下息肉计数的准确性
Temporally-Aware Supervised Contrastive Learning for Polyp Counting in Colonoscopy
- 设计时间感知的监督对比损失,利用时序软标签增强特征学习
- 在留一法验证中,碎片化率降低2.2倍,显著减少误关联
- 适合需要高精度息肉计数的临床辅助系统开发者
结肠镜下自动息肉计数是实现检查报告自动化和质量控制的关键步骤,旨在提高筛查成本效益。计数任务涉及检测与追踪息肉,并将属于同一息肉实体的轨迹片段聚类。现有方法依赖自监督学习,主要利用视觉外观信息,忽视了轨迹特征学习与聚类阶段中的时间关系。本文提出一种范式转变:引入结合时间感知软标签的监督对比损失,捕捉息肉内部变异性的同时保持不同息肉间的可区分性,从而提升聚类鲁棒性。此外,通过引入时间邻近约束改进轨迹聚类,有效减少视觉相似但时间上相距较远的轨迹间错误重新关联。我们在公开数据集上训练并验证方法,采用留一法交叉验证策略。结果表明,相比先前方法,碎片化率降低2.2倍。实验强调了时间感知在息肉计数中的重要性,建立了新的最先进水平。代码已开源:https://github.com/lparolari/temporally-aware-polyp-counting。
原文摘要 · Abstract (English)
Automated polyp counting in colonoscopy is a crucial step toward automated procedure reporting and quality control, aiming to enhance the cost-effectiveness of colonoscopy screening. Counting polyps in a procedure involves detecting and tracking polyps, and then clustering tracklets that belong to the same polyp entity. Existing methods for polyp counting rely on self-supervised learning and primarily leverage visual appearance, neglecting temporal relationships in both tracklet feature learning and clustering stages. In this work, we introduce a paradigm shift by proposing a supervised contrastive loss that incorporates temporally-aware soft targets. Our approach captures intra-polyp variability while preserving inter-polyp discriminability, leading to more robust clustering. Additionally, we improve tracklet clustering by integrating a temporal adjacency constraint, reducing false positive re-associations between visually similar but temporally distant tracklets. We train and validate our method on publicly available datasets and evaluate its performance with a leave-one-out cross-validation strategy. Results demonstrate a 2.2x reduction in fragmentation rate compared to prior approaches. Our results highlight the importance of temporal awareness in polyp counting, establishing a new state-of-the-art. Code is available at https://github.com/lparolari/temporally-aware-polyp-counting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。