通过分阶段生成结构与颜色,提升从H&E到IHC的图像转换质量。
Progressive Translation of H&E to IHC with Enhanced Structural Fidelity
- 分阶段优化颜色、细胞边界与结构,解耦生成过程。
- 在HER2和ER数据集上显著提升细节清晰度与颜色保真度。
- 适合病理图像分析、低成本蛋白定位研究者使用。
相比苏木精-伊红(H&E)染色,免疫组织化学(IHC)不仅保留组织结构特征,还能提供高分辨率的蛋白定位信息,对病理诊断至关重要。然而,IHC成本高、耗时长,且难以多路复用,限制了其在资源有限地区的广泛应用。因此,研究者正探索计算染色转换技术,从H&E切片合成等效IHC图像,以更高效、低成本获取蛋白水平信息。现有方法通常采用单一目标函数中多个损失项的线性加权,忽视各组件间的相互依赖,导致图像质量不佳,难以同时保持结构真实性和颜色准确性。为此,本文提出一种新型渐进式网络架构,融合颜色与细胞边界生成逻辑,实现各视觉维度的阶段性、解耦优化。基于自适应监督块NCE(ASP)框架,引入基于3,3'-二氨基联苯胺(DAB)染料浓度和图像梯度的额外损失函数,增强生成IHC图像的颜色保真度与细胞边界清晰度。通过重构生成流程为结构-颜色-细胞边界渐进机制,在HER2与ER数据集上的实验表明,该模型显著提升了视觉质量,实现了更精细的结构细节。
原文摘要 · Abstract (English)
Compared to hematoxylin-eosin (H&E) staining, immunohistochemistry (IHC) not only maintains the structural features of tissue samples, but also provides high-resolution protein localization, which is essential for aiding in pathology diagnosis. Despite its diagnostic value, IHC remains a costly and labor-intensive technique. Its limited scalability and constraints in multiplexing further hinder widespread adoption, especially in resource-limited settings. Consequently, researchers are increasingly exploring computational stain translation techniques to synthesize IHC-equivalent images from H&E-stained slides, aiming to extract protein-level information more efficiently and cost-effectively. However, most existing stain translation techniques rely on a linearly weighted summation of multiple loss terms within a single objective function, strategy that often overlooks the interdepedence among these components-resulting in suboptimal image quality and an inability to simultaneously preserve structural authenticity and color fidelity. To address this limitation, we propose a novel network architecture that follows a progressive structure, incorporating color and cell border generation logic, which enables each visual aspect to be optimized in a stage-wise and decoupled manner. To validate the effectiveness of our proposed network architecture, we build upon the Adaptive Supervised PatchNCE (ASP) framework as our baseline. We introduce additional loss functions based on 3,3'-diaminobenzidine (DAB) chromogen concentration and image gradient, enhancing color fidelity and cell boundary clarity in the generated IHC images. By reconstructing the generation pipeline using our structure-color-cell boundary progressive mechanism, experiments on HER2 and ER datasets demonstrated that the model significantly improved visual quality and achieved finer structural details.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。