arXiv:2605.16519cs.CVeess.SP2026-05中稿 · the International …被引 1

轻量级结肠镜图像分割模型,抗模糊与光照变化,实时运行

DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy

论文配图:DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy
图 1 · 摘自论文原文
  • 利用伪深度引导多任务学习,结合高效特征调制机制
  • 仅357万参数,0.86 GMACs,移动端实测超180 FPS
  • 在真实手术视频上优于大20倍的模型,适合临床部署

结肠镜中精准识别息肉对早期结直肠癌筛查至关重要,但实际临床环境存在运动模糊、反光和光照不稳等挑战。现有方法多在干净数据集上优化,部署到真实手术场景时性能显著下降。本文提出DepthPolyp,一种基于伪深度引导的多任务学习与高效特征调制的轻量级分割框架。该架构融合分层Ghost因子分解实现紧凑特征生成、交错混洗融合实现低成本跨尺度交互、动态分组门控实现自适应分组特征加权。大量实验表明,该模型在劣化数据上训练后,在干净与嘈杂目标域上均表现出强跨数据集泛化能力,持续超越轻量级基线,并保持与大幅模型相当的性能。在PolypGen真实手术视频评估中,其分割效果优于参数量达20倍以上的模型,同时维持实时推理速度。模型仅含357万参数和0.86 GMACs,可在移动设备上实现超过180 FPS的运行速度,适用于资源受限的临床环境。代码与预训练权重已公开。

原文摘要 · Abstract (English)

Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent challenges such as motion blur, specular reflections, and illumination instability. Most existing methods are optimized on clean benchmark images and suffer noticeable performance degradation when deployed in authentic surgical scenarios. We propose DepthPolyp, a lightweight and robust segmentation framework based on pseudo-depth-guided multi-task learning and efficient feature modulation. The architecture combines hierarchical Ghost factorization for compact feature generation, Interleaved Shuffle Fusion for low-cost cross-scale interaction, and Dynamic Group Gating for adaptive group-wise feature weighting. Extensive experiments demonstrate that DepthPolyp achieves strong cross-dataset generalization when trained on degraded data and evaluated on both clean and noisy target domains, consistently outperforming lightweight baselines and remaining competitive with substantially larger models. In real surgical video evaluation on PolypGen, DepthPolyp achieves better segmentation performance than models up to $20\times$ larger while preserving real-time inference speed. With only 3.57M parameters and 0.86 GMACs, the proposed method runs at over 180 FPS on mobile devices, making it well suited for real-time deployment in resource-constrained clinical environments. Code and pretrained weights are available at: https://github.com/ReaganWu/DepthPolyp/

医学图像分割轻量级模型实时推理结肠镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。