让病理图像分割更智能,支持医生互动修正并直接关联临床结果。
VISTA-PATH: An interactive foundation model for pathology image segmentation and quantitative analysis in computational pathology
- 结合视觉、语义描述和专家空间提示,实现多类病理结构精准分割。
- 在9个器官93类组织上验证,分割精度显著优于现有模型。
- 支持医生局部标注后自动扩展到全切片,适合临床研究与诊断辅助。
组织病理图像的精确语义分割对定量组织分析和下游临床建模至关重要。现有分割基础模型虽通过大规模预训练提升泛化能力,但因将分割视为静态视觉预测任务,难以适配病理学需求。本文提出VISTA-PATH,一种交互式、类别感知的病理图像分割基础模型,可应对异质性结构,融入专家反馈,并生成对临床解读有意义的像素级分割结果。该模型联合依赖视觉上下文、组织语义描述及可选的专家空间提示,实现跨异质病理图像的高精度多类别分割。为支撑此范式,我们构建了包含超160万张图像-掩码-文本三元组的VISTA-PATH Data数据集,覆盖9个器官和93类组织。在多个内部与外部基准测试中,VISTA-PATH持续优于现有分割基础模型。尤为重要的是,其支持动态人机协同优化:通过稀疏的局部框标注反馈,可自动传播至整张幻灯片分割。最后,我们展示由VISTA-PATH生成的高保真、类别感知分割结果是计算病理学的理想模型,通过提出的肿瘤互作评分(TIS)显著关联患者生存率,增强组织微环境分析能力。这些成果确立了VISTA-PATH作为从静态预测转向交互式、临床导向数字病理表征的基础模型。代码与演示详见 https://github.com/zhihuanglab/VISTA-PATH。
原文摘要 · Abstract (English)
Accurate semantic segmentation for histopathology image is crucial for quantitative tissue analysis and downstream clinical modeling. Recent segmentation foundation models have improved generalization through large-scale pretraining, yet remain poorly aligned with pathology because they treat segmentation as a static visual prediction task. Here we present VISTA-PATH, an interactive, class-aware pathology segmentation foundation model designed to resolve heterogeneous structures, incorporate expert feedback, and produce pixel-level segmentation that are directly meaningful for clinical interpretation. VISTA-PATH jointly conditions segmentation on visual context, semantic tissue descriptions, and optional expert-provided spatial prompts, enabling precise multi-class segmentation across heterogeneous pathology images. To support this paradigm, we curate VISTA-PATH Data, a large-scale pathology segmentation corpus comprising over 1.6 million image-mask-text triplets spanning 9 organs and 93 tissue classes. Across extensive held-out and external benchmarks, VISTA-PATH consistently outperforms existing segmentation foundation models. Importantly, VISTA-PATH supports dynamic human-in-the-loop refinement by propagating sparse, patch-level bounding-box annotation feedback into whole-slide segmentation. Finally, we show that the high-fidelity, class-aware segmentation produced by VISTA-PATH is a preferred model for computational pathology. It improve tissue microenvironment analysis through proposed Tumor Interaction Score (TIS), which exhibits strong and significant associations with patient survival. Together, these results establish VISTA-PATH as a foundation model that elevates pathology image segmentation from a static prediction to an interactive and clinically grounded representation for digital pathology. Source code and demo can be found at https://github.com/zhihuanglab/VISTA-PATH.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。