arXiv:2512.08439cs.CV2025-12被引 3

用分层概念演化预训练,让手术图像分割模型更通用。

LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-training

  • 构建分层解码器和父子查询嵌入,统一解剖、组织、器械等概念
  • 通过置信度驱动的伪标签迭代生成,获得114K张无标注手术图像配对数据
  • 在多个手术场景中表现优于现有方法,适合需要泛化的临床分割任务

手术分割对场景理解至关重要,但受限于标注稀缺和不同术式间的语义不一致。现有方法通常仅微调自然基础模型(如SAM),作为领域适配器,难以跨多样化手术目标泛化。为此,我们提出LapFM,一种基于分层概念演化预训练的手术分割基础模型。首先,通过具有父子查询嵌入的分层掩码解码器建立腹腔镜概念层次结构(LCH),将解剖、组织、器械等实体整合为可扩展的知识体系,实现跨粒度语义一致性。其次,提出置信度驱动的演化标注机制,基于层次一致性迭代生成并过滤伪标签,逐步将可靠样本从无标注图像中引入训练。该过程构建了包含114,000张图像-掩码对的大规模基准数据集LapBench-114K。大量实验表明,LapFM显著超越当前最优方法,在通用腹腔镜分割中建立了新的粒度自适应泛化标准。代码已开源:https://github.com/xq141839/LapFM。

原文摘要 · Abstract (English)

Surgical segmentation is pivotal for scene understanding yet remains hindered by annotation scarcity and semantic inconsistency across diverse procedures. Existing approaches typically fine-tune natural foundation models (e.g., SAM) with limited supervision, functioning merely as domain adapters rather than surgical foundation models. Consequently, they struggle to generalize across the vast variability of surgical targets. To bridge this gap, we present LapFM, a foundation model designed to evolve robust segmentation capabilities from massive unlabeled surgical images. Distinct from medical foundation models relying on inefficient self-supervised proxy tasks, LapFM leverages a Hierarchical Concept Evolving Pre-training paradigm. First, we establish a Laparoscopic Concept Hierarchy (LCH) via a hierarchical mask decoder with parent-child query embeddings, unifying diverse entities (i.e., Anatomy, Tissue, and Instrument) into a scalable knowledge structure with cross-granularity semantic consistency. Second, we propose a Confidence-driven Evolving Labeling that iteratively generates and filters pseudo-labels based on hierarchical consistency, progressively incorporating reliable samples from unlabeled images into training. This process yields LapBench-114K, a large-scale benchmark comprising 114K image-mask pairs. Extensive experiments demonstrate that LapFM significantly outperforms state-of-the-art methods, establishing new standards for granularity-adaptive generalization in universal laparoscopic segmentation. The source code is available at https://github.com/xq141839/LapFM.

手术分割基础模型无监督学习分层建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。