用扩散模型实现高保真染色图像转换,提升病理分析的准确性与成本效益。
HistDiST: Histopathological Diffusion-based Stain Transfer
- 基于潜在扩散模型,结合形态特征与结构编码,实现精准染色转换。
- 在Ki67翻译任务中,分子相关性指标提升28%,显著优于现有方法。
- 适合需要低成本替代免疫组化但又关注分子信息的研究者使用。
苏木精-伊红(H&E)染色是组织病理学的基础,但缺乏分子特异性。虽然免疫组织化学(IHC)可提供分子信息,但成本高且流程复杂,促使人们探索以H&E到IHC的图像转换作为经济高效的替代方案。现有方法多基于生成对抗网络(GAN),常面临训练不稳定和结构保真度有限的问题,而基于扩散模型的方法尚未充分研究。本文提出HistDiST,一种基于潜在扩散模型(LDM)的高保真H&E-to-IHC转换框架。HistDiST引入双条件策略,利用Phikon提取的形态嵌入与VAE编码的H&E表示,确保病理相关上下文与结构一致性。为克服亮度偏差,采用重缩放噪声调度、v-prediction及尾部时间步,强制最终时间步满足零信噪比(zero-SNR)条件。推理时,DDIM反演保持形态结构,而eta-cosine噪声调度引入可控随机性,平衡结构一致性和分子保真度。此外,提出分子检索准确率(MRA)这一新型病理感知指标,基于GigaPath嵌入评估分子相关性。在MIST与BCI数据集上的大量实验表明,HistDiST显著优于现有方法,在H&E-to-Ki67转换任务中MRA提升28%,验证了其捕捉真实IHC语义的有效性。
原文摘要 · Abstract (English)
Hematoxylin and Eosin (H&E) staining is the cornerstone of histopathology but lacks molecular specificity. While Immunohistochemistry (IHC) provides molecular insights, it is costly and complex, motivating H&E-to-IHC translation as a cost-effective alternative. Existing translation methods are mainly GAN-based, often struggling with training instability and limited structural fidelity, while diffusion-based approaches remain underexplored. We propose HistDiST, a Latent Diffusion Model (LDM) based framework for high-fidelity H&E-to-IHC translation. HistDiST introduces a dual-conditioning strategy, utilizing Phikon-extracted morphological embeddings alongside VAE-encoded H&E representations to ensure pathology-relevant context and structural consistency. To overcome brightness biases, we incorporate a rescaled noise schedule, v-prediction, and trailing timesteps, enforcing a zero-SNR condition at the final timestep. During inference, DDIM inversion preserves the morphological structure, while an eta-cosine noise schedule introduces controlled stochasticity, balancing structural consistency and molecular fidelity. Moreover, we propose Molecular Retrieval Accuracy (MRA), a novel pathology-aware metric leveraging GigaPath embeddings to assess molecular relevance. Extensive evaluations on MIST and BCI datasets demonstrate that HistDiST significantly outperforms existing methods, achieving a 28% improvement in MRA on the H&E-to-Ki67 translation task, highlighting its effectiveness in capturing true IHC semantics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。