arXiv:2508.02464cs.CV2025-08被引 2

让病理图像分割更懂医生意图,用少量模糊提示也能精准分割。

SAMPO-Path: Segmentation Intent-Aligned Preference Optimization for Pathology Foundation Model Segmentation

  • 通过偏好优化对齐医生真实分割意图,提升模型理解力。
  • 在4个任务、12个外部数据集上均显著提升准确率与鲁棒性。
  • 适合临床医生、病理研究者使用,尤其适用于复杂密集图像。

基础模型在多物体分割中表现优异,但组织病理图像因细胞密度高、异质性强,且像素级标注与临床分割意图(如仅分割特定类型细胞核)存在差距,导致难以应用。实际中,医生常使用多样且含噪的提示,造成提示与意图错位及预测不一致。本文提出SAMPO(基于偏好优化的分割模型),首次将直接偏好优化(DPO)应用于纯视觉基础模型,实现从极少且不完美提示中获得精确分割。框架包含三大核心:(1)在线提示中心偏好挖掘,生成跨提示质量的偏好对;(2)多掩码偏好学习,利用输出模糊性获取细粒度排序监督;(3)混合损失函数,结合偏好优化与像素级监督以保证训练稳定。在两个数据集覆盖四个任务上训练,并在对应测试集及12个外部验证数据集上评估,SAMPO持续提升分割精度、对提示变化的鲁棒性及临床意图符合度。

原文摘要 · Abstract (English)

Foundation models have shown strong performance in multi-object segmentation with visual prompts, yet histopathology images remain challenging due to high cellular density, heterogeneity, and the gap between pixel-level supervision and clinical segmentation intent (e.g., selectively segmenting nuclei of a specific type). In practice, such intents are expressed through diverse and noisy prompts, causing prompt-intent misalignment and inconsistent predictions. We introduce SAMPO (Segmentation Anything Model with Preference Optimization), a preference-aligned fine-tuning framework that explicitly aligns pathology foundation models with clinical segmentation intent. SAMPO is the first to adapt Direct Preference Optimization (DPO) to pure vision foundation models, enabling accurate segmentation from minimal and imperfect prompts. The framework features three key components: (1) online prompt-centric preference mining to synthesize preference pairs across prompt qualities; (2) multi-mask preference learning to leverage output ambiguity for fine-grained ranking supervision; and (3) a hybrid loss combining preference optimization with pixel-level supervision for stable training. Trained on two datasets covering four tasks and evaluated on corresponding test sets and 12 external validation datasets, SAMPO consistently improves segmentation accuracy, robustness to prompt variations, and clinical intent adherence in dense histopathology images.

病理分割偏好优化医学图像弱监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。