真实结肠镜视频检测中,模型在标准数据集上表现好,但在完整手术视频中性能大幅下降。
TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection

- 用完整手术视频构建新基准,揭示模型训练与实际应用间的性能断层
- 在真实视频中,仅用精选片段训练的模型准确率暴跌,而全程训练模型显著减少误报
- 推荐以全流程数据和部署指标替代传统聚焦病变的评估方式,适合临床研究者
结肠镜辅助检测(CADe)系统有望降低漏诊率,但其真实世界部署仍面临挑战。这一差距部分源于模型开发中的结构性缺陷:依赖于过度筛选的数据集,这些数据未充分反映常规检查中的长段阴性区域和操作相关伪影。在以病变为中心的基准上训练和评估模型,会产生虚假的成功感,因其无法捕捉临床关键指标。为此,我们建立了TRUE-Colon标准化评估协议,同时衡量定位精度与部署关键特性,并在精选基准(SUN、PICCOLO)和60段未经剪辑的完整手术过程(REAL-Colon)上评估了四种实时架构(Faster R-CNN、YOLOv8、YOLOv11、RT-DETR)。结果发现一致的迁移不对称性:仅在精选片段上训练的模型在完整手术视频上性能严重下滑;而基于完整手术视频训练的模型在REAL-Colon上显著提升了非息肉内容的剔除能力,且在精选基准上保持较高准确率。此外,基于Transformer的检测器展现出最强敏感性和最早最持续的检测能力,而卷积模型则在更高吞吐量下保持竞争力。结果表明,可部署的CADe系统应在全流程数据和部署相关指标下进行训练与评估。代码已开源。
原文摘要 · Abstract (English)
Computer-aided detection (CADe) systems for colonoscopy promise to reduce clinical miss rates, yet reliable real-world deployment remains elusive. This translational gap stems in part from a structural flaw in model development: the reliance on curated datasets that under-represent the long negative stretches and procedure-related artifacts characteristic of routine examinations. Training and evaluating architectures strictly on these lesion-centric benchmarks creates an illusion of success, since such benchmarks cannot capture clinically crucial metrics. To expose this gap, we establish TRUE-Colon, a standardized benchmarking protocol that measures key deployment characteristics alongside localization accuracy, and evaluate four real-time architectures (Faster R-CNN, YOLOv8, YOLOv11, RT-DETR) across curated benchmarks (SUN, PICCOLO) and 60 unedited, full-length procedures (REAL-Colon). We observe a consistent transfer asymmetry: models trained strictly on curated clips suffer a severe performance collapse when evaluated on full procedures, whereas procedure-trained models substantially improve rejection of non-polyp content on REAL-Colon, and largely retain their accuracy on curated benchmarks. Beyond transferability, we find that the Transformer detector attains the strongest sensitivity and the earliest, most persistent detections, while the convolutional detectors stay competitive at a higher throughput. Together, these results indicate that both training and benchmarking for deployable CADe should shift from curated, lesion-centric clips toward full-procedure data and deployment-relevant operating points. Source code is available at https://github.com/sdoerrich97/true-colon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。