arXiv:2411.18169cs.CVcs.AI2024-11被引 1

用视觉提示提升内镜下剥离区域分割精度,助力手术安全

PDZSeg: Adapting the Foundation Model for Dissection Zone Segmentation with Visual Prompts in Robot-assisted Endoscopic Submucosal Dissection

  • 引入涂鸦、框选等视觉提示,灵活引导模型分割
  • 在ESD-DZSeg数据集上显著优于现有方法
  • 首次将视觉提示用于内镜剥离区分割,适合临床辅助研究

内镜手术环境因组织边界模糊,导致剥离区域分割易出错。本研究提出基于提示的剥离区域分割(PDZSeg)模型,通过叠加涂鸦、边界框等视觉提示,并在专用数据集上微调基础模型,提升分割性能与交互体验。在三种实验设置下验证:域内评估、提示可用性变化及鲁棒性测试。基于ESD-DZSeg数据集的结果显示,该方法优于当前先进分割模型。本研究首次将视觉提示设计引入剥离区域分割领域,构建了首个相关基准数据集,为后续研究奠定基础。

原文摘要 · Abstract (English)

Purpose: Endoscopic surgical environments present challenges for dissection zone segmentation due to unclear boundaries between tissue types, leading to segmentation errors where models misidentify or overlook edges. This study aims to provide precise dissection zone suggestions during endoscopic submucosal dissection (ESD) procedures, enhancing ESD safety. Methods: We propose the Prompted-based Dissection Zone Segmentation (PDZSeg) model, designed to leverage diverse visual prompts such as scribbles and bounding boxes. By overlaying these prompts onto images and fine-tuning a foundational model on a specialized dataset, our approach improves segmentation performance and user experience through flexible input methods. Results: The PDZSeg model was validated using three experimental setups: in-domain evaluation, variability in visual prompt availability, and robustness assessment. Using the ESD-DZSeg dataset, results show that our method outperforms state-of-the-art segmentation approaches. This is the first study to integrate visual prompt design into dissection zone segmentation. Conclusion: The PDZSeg model effectively utilizes visual prompts to enhance segmentation performance and user experience, supported by the novel ESD-DZSeg dataset as a benchmark for dissection zone segmentation in ESD. Our work establishes a foundation for future research.

医学图像分割视觉提示内镜手术AI辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。