arXiv:2409.19983cs.CV2024-09

提出时空自校正检测器,提升结肠镜视频中息肉定位精度。

TSdetector: Temporal-Spatial Self-correction Collaborative Learning for Colonoscopy Video Detection

论文配图:TSdetector: Temporal-Spatial Self-correction Collaborative Learning for Colonoscopy Video Detection
图 1 · 摘自论文原文
  • 融合时序一致性和空间可靠性学习,动态优化检测过程。
  • 在三个公开数据集上达到最高息肉检出率,优于现有方法。
  • 适合医疗视频分析、内窥镜智能辅助诊断领域研究者参考。

基于CNN的目标检测模型在息肉检测任务中逐渐实现性能与速度的平衡。然而,在复杂的结肠镜视频场景中准确定位息肉仍具挑战性,因现有方法忽略了序列内分布异质性与置信度-精度不匹配两个关键问题。为此,本文提出一种新型时序-空间自校正检测器(TSdetector),首次集成时序一致性学习与空间可靠性学习,实现连续目标检测。技术上,提出全局时序感知卷积,整合前序信息动态引导当前卷积核关注序列间全局特征;设计分层队列融合机制,通过渐进式累积方式融合多时序特征,充分挖掘上下文一致性信息并保留长序列依赖特征。同时,在空间层面,引入位置感知聚类,探索候选框间的空间关系以自适应重校准预测置信度,高效消除冗余边界框。在三个公开息肉视频数据集上的实验结果表明,TSdetector实现了最高的息肉检测率,显著优于其他先进方法。代码已开源:https://github.com/soleilssss/TSdetector。

原文摘要 · Abstract (English)

CNN-based object detection models that strike a balance between performance and speed have been gradually used in polyp detection tasks. Nevertheless, accurately locating polyps within complex colonoscopy video scenes remains challenging since existing methods ignore two key issues: intra-sequence distribution heterogeneity and precision-confidence discrepancy. To address these challenges, we propose a novel Temporal-Spatial self-correction detector (TSdetector), which first integrates temporal-level consistency learning and spatial-level reliability learning to detect objects continuously. Technically, we first propose a global temporal-aware convolution, assembling the preceding information to dynamically guide the current convolution kernel to focus on global features between sequences. In addition, we designed a hierarchical queue integration mechanism to combine multi-temporal features through a progressive accumulation manner, fully leveraging contextual consistency information together with retaining long-sequence-dependency features. Meanwhile, at the spatial level, we advance a position-aware clustering to explore the spatial relationships among candidate boxes for recalibrating prediction confidence adaptively, thus eliminating redundant bounding boxes efficiently. The experimental results on three publicly available polyp video dataset show that TSdetector achieves the highest polyp detection rate and outperforms other state-of-the-art methods. The code can be available at https://github.com/soleilssss/TSdetector.

医学图像视频检测自校正息肉识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。