arXiv:2606.07633cs.CVcs.AI2026-06

提出融合Transformer与CNN的自适应核分割网络,提升病理图像细分精度。

AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation

论文配图:AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation
图 1 · 摘自论文原文
  • 双编码器融合Swim Transformer与ResNet-50,动态加权各尺度特征
  • 在CoNIC数据集上达0.82的Dice和0.68的F1,淋巴细胞类达0.67
  • 引入边界感知与不确定性建模,适合医学图像细粒度分割任务

组织病理学图像中核亚型的准确分类对肿瘤分级、免疫浸润量化及预后预测等下游任务至关重要。现有方法多仅依赖卷积或Transformer编码器,难以同时捕捉细粒度局部纹理与长程空间上下文。本文提出AMN(自适应多尺度核网络),一种双编码器分割框架,联合使用Swin Transformer与ResNet-50特征金字塔,通过可学习的通道级门控机制动态加权各编码器在每尺度的贡献。AMN采用多目标损失训练,包含类别加权焦点损失、强调正像素的边界感知损失,以及抑制过度自信错误预测的新颖不确定性调制分类项。在CoNIC基准上对七类核进行评估,平均Dice为0.82,平均F1为0.68,诊断挑战性较强的淋巴细胞类F1达0.67。AMN优于八种基线模型,涵盖纯CNN、纯Transformer及近期混合架构:U-Net、ResU-Net、DeepLabV3+、SegNet、ViT-Small、HmsU-Net、ConvFormer-UNet与BEFUnet。在MoNuSeg上的跨数据集评估显示无需重训练即具强泛化能力,验证了所学表征的域鲁棒性。

原文摘要 · Abstract (English)

Accurate classification of nuclei subtypes in histopathology images is critical for downstream tasks including tumor grading, immune infiltrate quantification, and prognosis prediction. Existing approaches rely on either convolutional or transformer-based encoders in isolation, limiting their ability to simultaneously capture fine-grained local texture and long-range spatial context. We present AMN (Adaptive Multi-Scale Nuclei Network), a dual-encoder segmentation framework that jointly leverages a Swin Transformer and a ResNet-50 feature pyramid, fused via a learned per-channel gating mechanism that dynamically weighs each encoder's contribution at every scale. AMN is trained with a multi-objective loss combining class-weighted focal loss, boundary-aware loss with positive-pixel emphasis, and a novel uncertainty-modulated classification term that suppresses overconfident erroneous predictions. Evaluated on the CoNIC benchmark across seven nuclei classes, AMN achieves a mean Dice of 0.82 and mean F1 of 0.68, with an F1 of 0.67 on the diagnostically challenging lymphocyte class. AMN outperforms eight baseline models spanning pure-CNN, pure-transformer, and recent hybrid architectures: U-Net, ResU-Net, DeepLabV3+, SegNet, ViT-Small, HmsU-Net, ConvFormer-UNet, and BEFUnet. Cross-dataset evaluation on MoNuSeg demonstrates strong generalization without retraining and validating the domain robustness of the learned representations.

核分割多尺度融合医学图像Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。