arXiv:2608.10649cs.CV2026-08

分三阶段自动识别肠息肉类型并分割,准确率超94%

PolypVision: A Three-Stage Hierarchical Deep Learning Framework for Classification and Segmentation of Colorectal Polyps

  • 分三阶段处理:先分类、再分割、后细分亚型,层层递进
  • 在三个数据集上达到94.4%检测精度,分类AUC接近0.99
  • 无需设备适配,可直接用于不同内镜系统,适合临床部署

结直肠癌(CRC)是全球癌症死亡的主要原因之一,主要源于癌前息肉。准确检测、分割及内镜与组织学分类对及时干预至关重要。本文提出PolypVision,一种三阶段分层深度学习框架:第一阶段用EfficientNetV2-M结合焦点损失,同时完成腺瘤性/增生性息肉二分类及Paris和JNet分类;第二阶段以第一阶段的主干网络为编码器,采用UNet++解码器,通过Dice和BCE损失优化息肉分割,并推荐切除方式;第三阶段利用第二阶段的迁移学习,用EfficientNetV2-M完成腺瘤亚型(管状、管状绒毛状、绒毛状)分类。在PolypGen、Kvasir-SEG和CVC-ClinicDB三个公开数据集上评估,框架在帧级分类中获得约0.99的AUC,于Kvasir-SEG上实现94.4%的mAP@50,优于或匹配现有方法。梯度加权类激活图(Grad-CAM)显示模型关注临床相关病变特征。该框架具备设备无关性,可在多种内镜成像系统上运行而无需硬件适配。结果表明,基于任务特定损失函数与迁移学习的分层管道可实现鲁棒、设备无关且临床有意义的自动化肠息肉分析。PolypVision已作为Web应用免费开放(https://polypvision.com),属DataBioX项目,提供面向所有用户的免费使用层级。

原文摘要 · Abstract (English)

Colorectal cancer (CRC) remains one of the leading causes of cancer-related mortality worldwide, predominantly arising from precancerous polyps. Accurate detection, segmentation, and endoscopic and histological classification of colorectal polyps are crucial for timely clinical intervention. In this study, we present PolypVision, a three-stage hierarchical deep learning framework that sequentially performs: (Stage 1) binary classification of polyps as adenomatous or hyperplastic, with simultaneous Paris and JNet classification, using EfficientNetV2-M with Focal Loss; (Stage 2) polyp segmentation with recommended resection method using a UNet++ decoder with the Stage 1 backbone as encoder, optimized with Dice and BCE losses; and (Stage 3) adenoma subtype classification (tubular, tubulovillous, villous) using EfficientNetV2-M with transfer learning from Stage 2. Evaluated on three public datasets -- PolypGen, Kvasir-SEG, and CVC-ClinicDB -- PolypVision achieves an AUC of approximately 0.99 for frame classification and a detection mAP@50 of 94.4% on Kvasir-SEG, outperforming or matching state-of-the-art methods. Gradient-weighted Class Activation Maps (Grad-CAM) confirm that the model attends to clinically relevant lesion features. The framework is device-independent, operating across diverse endoscopic imaging systems without hardware-specific adaptation. These results demonstrate that a hierarchical, transfer-learning-driven pipeline with task-specific loss functions offers a robust, device-independent, and clinically meaningful approach to automated colorectal polyp analysis. PolypVision is freely available as a web application at https://polypvision.com, a DataBioX initiative, with a free usage tier open to all users.

医学图像息肉分割深度学习临床辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。