arXiv:2412.17943eess.IV2024-12被引 3

用强化学习优化SAM提示点,提升多模态医学影像病灶分割精度与效率

Optimizing Prompt Strategies for SAM: Advancing lesion Segmentation Across Diverse Medical Imaging Modalities

  • 设计强化学习代理自动选择SAM提示点位置和数量
  • 五点以上提示使卵巢肿瘤分割Dice达0.806,显著优于单点
  • 相比人工标注,分割时间减少近10倍,适合临床快速应用

目的:评估多种分割一切模型(SAM)提示策略在四个独立的卵巢、肺、肾和乳腺肿瘤数据集上的表现,并开发强化学习(RL)代理以优化SAM提示位置。方法:本回顾性研究包含四组独立的卵巢、肺、肾和乳腺肿瘤患者数据。对所有病灶进行人工分割与SAM辅助分割。构建RL模型预测并选择提示点以最大化分割性能。采用配对t检验进行统计分析。结果:增加提示点数量显著提升分割准确率,卵巢肿瘤中单点提示的Dice系数为0.272,五点及以上时升至0.806。提示位置也影响性能,表面和联合基础提示优于中心提示,分别在卵巢和乳腺肿瘤中达到0.604和0.724的平均Dice系数。所提RL代理在卵巢肿瘤上实现最高Dice系数0.595,优于随机及其它RL策略。同时显著缩短分割时间,较人工方法提升近10倍。结论:尽管增加提示点和非中心提示普遍提升准确率,但每种病理类型与成像模态均有特定最优阈值与布局策略。本研究提出的RL代理在性能与效率上均优于现有方法。

原文摘要 · Abstract (English)

Purpose: To evaluate various Segmental Anything Model (SAM) prompt strategies across four lesions datasets and to subsequently develop a reinforcement learning (RL) agent to optimize SAM prompt placement. Materials and Methods: This retrospective study included patients with four independent ovarian, lung, renal, and breast tumor datasets. Manual segmentation and SAM-assisted segmentation were performed for all lesions. A RL model was developed to predict and select SAM points to maximize segmentation performance. Statistical analysis of segmentation was conducted using pairwise t-tests. Results: Results show that increasing the number of prompt points significantly improves segmentation accuracy, with Dice coefficients rising from 0.272 for a single point to 0.806 for five or more points in ovarian tumors. The prompt location also influenced performance, with surface and union-based prompts outperforming center-based prompts, achieving mean Dice coefficients of 0.604 and 0.724 for ovarian and breast tumors, respectively. The RL agent achieved a peak Dice coefficient of 0.595 for ovarian tumors, outperforming random and alternative RL strategies. Additionally, it significantly reduced segmentation time, achieving a nearly 10-fold improvement compared to manual methods using SAM. Conclusion: While increased SAM prompts and non-centered prompts generally improved segmentation accuracy, each pathology and modality has specific optimal thresholds and placement strategies. Our RL agent achieved superior performance compared to other agents while achieving a significant reduction in segmentation time.

医学影像分割模型强化学习SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。