用生成式强化网络减少70%标注量,提升3D超声图像组织分割精度。
Segmentation-Aware Generative Reinforcement Network (GRN) for Tissue Layer Segmentation in 3-D Ultrasound Images for Chronic Low-back Pain (cLBP) Assessment
- 通过分割反馈优化生成与分割,单阶段联合训练提升性能。
- 标注减少70%仍保持高精度,Dice系数提升1.98%。
- 适合标注成本高、数据稀缺的医学影像分析场景。
本文提出一种新型分割感知联合训练框架——生成式强化网络(GRN),通过分割损失反馈同时优化图像生成与分割性能。开发了分割引导增强(SGE)技术,使生成器为分割模型定制高质量图像。提出两种变体:样本高效学习型GRN-SEL和半监督学习型GRN-SSL。在69例共29名受试者的3D超声扫描数据集上评估,包含6个解剖结构:表皮、浅层脂肪、浅筋膜膜(SFM)、深层脂肪、深筋膜膜(DFM)和肌肉。结果表明,使用SGE的GRN-SEL可将标注需求降低70%,且相比全标注数据训练模型,Dice相似系数(DSC)提升1.98%;仅用GRN-SEL可降标60%,结合SGE的GRN-SSL可降标70%,纯GRN-SSL降标60%,所有方法性能均接近全监督模型。这表明该框架可在显著减少标注量的同时有效提升分割性能,为超声影像分析提供可扩展、高效的解决方案。
原文摘要 · Abstract (English)
We introduce a novel segmentation-aware joint training framework called generative reinforcement network (GRN) that integrates segmentation loss feedback to optimize both image generation and segmentation performance in a single stage. An image enhancement technique called segmentation-guided enhancement (SGE) is also developed, where the generator produces images tailored specifically for the segmentation model. Two variants of GRN were also developed, including GRN for sample-efficient learning (GRN-SEL) and GRN for semi-supervised learning (GRN-SSL). GRN's performance was evaluated using a dataset of 69 fully annotated 3D ultrasound scans from 29 subjects. The annotations included six anatomical structures: dermis, superficial fat, superficial fascial membrane (SFM), deep fat, deep fascial membrane (DFM), and muscle. Our results show that GRN-SEL with SGE reduces labeling efforts by up to 70% while achieving a 1.98% improvement in the Dice Similarity Coefficient (DSC) compared to models trained on fully labeled datasets. GRN-SEL alone reduces labeling efforts by 60%, GRN-SSL with SGE decreases labeling requirements by 70%, and GRN-SSL alone by 60%, all while maintaining performance comparable to fully supervised models. These findings suggest the effectiveness of the GRN framework in optimizing segmentation performance with significantly less labeled data, offering a scalable and efficient solution for ultrasound image analysis and reducing the burdens associated with data annotation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。