arXiv:2602.17793cs.CVeess.IV2026-02

用H&E切片直接预测乳腺癌HER2分型,效率更高且更准。

LGD-Net: Latent-Guided Dual-Stream Network for HER2 Scoring with Task-Specific Domain Knowledge

  • 不生成虚拟染色图像,直接在特征层面实现跨模态映射
  • 在BCI数据集上达到当前最优性能,优于基线方法
  • 融合细胞分布和膜染色强度等临床知识提升准确性

准确评估HER2表达水平对乳腺癌诊断和靶向治疗选择至关重要。然而,标准的多步骤免疫组化(IHC)染色成本高、耗时长,且在许多地区不可及。因此,直接从H&E切片预测HER2水平成为潜在替代方案。已有研究证明,通过H&E图像生成虚拟IHC图像可实现自动HER2评分,但像素级虚拟染色方法计算开销大,易产生重建伪影并传播诊断误差。为此,我们提出隐空间引导的双流网络(LGD-Net),采用跨模态特征幻觉而非显式像素级图像生成。LGD-Net在训练中利用教师IHC编码器引导,将形态学H&E特征直接映射至分子隐空间。为确保幻觉特征捕捉临床相关表型,我们通过轻量级辅助任务,显式引入核分布和膜染色强度等任务特定领域知识进行正则化。在公开的BCI数据集上的大量实验表明,LGD-Net达到当前最优性能,显著优于基线方法,同时仅需单模态H&E输入即可实现高效推理。

原文摘要 · Abstract (English)

It is a critical task to evalaute HER2 expression level accurately for breast cancer evaluation and targeted treatment therapy selection. However, the standard multi-step Immunohistochemistry (IHC) staining is resource-intensive, expensive, and time-consuming, which is also often unavailable in many areas. Consequently, predicting HER2 levels directly from H&E slides has emerged as a potential alternative solution. It has been shown to be effective to use virtual IHC images from H&E images for automatic HER2 scoring. However, the pixel-level virtual staining methods are computationally expensive and prone to reconstruction artifacts that can propagate diagnostic errors. To address these limitations, we propose the Latent-Guided Dual-Stream Network (LGD-Net), a novel framework that employes cross-modal feature hallucination instead of explicit pixel-level image generation. LGD-Net learns to map morphological H&E features directly to the molecular latent space, guided by a teacher IHC encoder during training. To ensure the hallucinated features capture clinically relevant phenotypes, we explicitly regularize the model training with task-specific domain knowledge, specifically nuclei distribution and membrane staining intensity, via lightweight auxiliary regularization tasks. Extensive experiments on the public BCI dataset demonstrate that LGD-Net achieves state-of-the-art performance, significantly outperforming baseline methods while enabling efficient inference using single-modality H&E inputs.

病理分析HER2分型跨模态学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。