将细胞核检测转为逐点预测,提升定位精度与效率。
NuNext: Reframing Nucleus Detection as Next-Point Detection
- 用多模态大模型直接预测细胞核中心点,避免复杂后处理。
- 在九个基准上实现最优性能,平均精度显著超越现有方法。
- 适合医学图像分析、病理诊断自动化等研究者参考。
组织病理学中的细胞核检测对临床应用至关重要。现有方法要么回归核代理图需复杂后处理,要么使用密集锚点或查询导致前景-背景严重失衡。本文将细胞核检测重新定义为下一位置预测任务,构建多模态大语言模型,直接从输入图像输出前景细胞核中心点。模型分两阶段训练:监督学习阶段提出空间感知软监督以放宽严格中心点匹配,并采用视觉思维链策略引入视觉先验以辅助坐标预测;强化学习微调阶段设计分布匹配奖励、低方差组过滤和细粒度优势塑造,进一步提升检测质量。在九个广泛使用的基准上进行的大量实验表明,该方法具有显著优势。代码即将发布。
原文摘要 · Abstract (English)
Nucleus detection in histopathology is pivotal for a wide range of clinical applications. Existing approaches either regress nuclear proxy maps that require complex post-processing, or employ dense anchors or queries that introduce severe foreground-background imbalance. In this work, we reformulate nucleus detection as next-point prediction, wherein a multimodal large language model is developed to directly output foreground nucleus centroids from the input image. The model is trained in two stages. In the supervised learning stage, we propose spatial-aware soft supervision to relax strict centroid matching and a chain-of-visual-thought strategy to incorporate visual priors that facilitate coordinate prediction. In the reinforcement fine-tuning stage, we design distribution matching reward, low-variance group filtering, and fine-grained advantage shaping to further improve the model's detection quality. Extensive experiments on nine widely used benchmarks demonstrate the superiority of our method. Code will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。