arXiv:2503.04634cs.CV2025-03被引 5

用肿瘤感知修复法生成病理图像,提升小样本分割效果。

PathoPainter: Augmenting Histopathology Segmentation via Tumor-aware Inpainting

  • 将图像掩码生成转为肿瘤区域修复任务,保证图掩对齐
  • 在CAMELYON16上分割准确率从75.69%提升至77.69%
  • 适合缺乏标注数据的病理图像分割研究者使用

肿瘤分割在病理图像分析中至关重要,但需病理学家标注精细的图像-掩码对,成本高昂。因此,合成病理数据以扩充数据集极具价值。现有方法在图像-掩码对的准确性与多样性方面存在不足,影响模型训练,尤其在小样本和复杂病理图像场景下。为此,我们提出PathoPainter,将图像-掩码对生成重构为肿瘤修复任务:保留背景,仅修复肿瘤区域,确保生成图像与其掩码精确对齐。为提升数据多样性并保持生物学合理性,我们引入基于其他图像区域嵌入的采样机制来指导肿瘤修复。此外,设计过滤策略剔除不确定的合成区域,进一步提高数据质量。我们在多个包含不同肿瘤类型及不同训练规模的数据集上进行评估。结果表明,使用合成数据后分割性能显著提升,优于现有合成方法,如在CAMELYON16上从75.69%提升至77.69%。代码已公开于https://github.com/HongLiuuuuu/PathoPainter。

原文摘要 · Abstract (English)

Tumor segmentation plays a critical role in histopathology, but it requires costly, fine-grained image-mask pairs annotated by pathologists. Thus, synthesizing histopathology data to expand the dataset is highly desirable. Previous works suffer from inaccuracies and limited diversity in image-mask pairs, both of which affect training segmentation, particularly in small-scale datasets and the inherently complex nature of histopathology images. To address this challenge, we propose PathoPainter, which reformulates image-mask pair generation as a tumor inpainting task. Specifically, our approach preserves the background while inpainting the tumor region, ensuring precise alignment between the generated image and its corresponding mask. To enhance dataset diversity while maintaining biological plausibility, we incorporate a sampling mechanism that conditions tumor inpainting on regional embeddings from a different image. Additionally, we introduce a filtering strategy to exclude uncertain synthetic regions, further improving the quality of the generated data. Our comprehensive evaluation spans multiple datasets featuring diverse tumor types and various training data scales. As a result, segmentation improved significantly with our synthetic data, surpassing existing segmentation data synthesis approaches, e.g., 75.69% -> 77.69% on CAMELYON16. The code is available at https://github.com/HongLiuuuuu/PathoPainter.

病理分割图像修复数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。