通过特征增强实现H&E到IHC染色的自适应融合,减少信息损失。
Adaptive H&E-IHC information fusion staining framework based on feature extra
- 引入多尺度与小波卷积的特征提取模块,增强颜色信息保留。
- 对比学习训练双特征提取器,在高维空间对齐HE-IHC特征。
- 自适应调整损失函数,解决染色模糊与信息不对称问题。
免疫组化(IHC)在乳腺癌等疾病评估中至关重要。基于生成模型的H&E到IHC转换提供了一种简便且低成本的获取IHC图像的方法。尽管已有模型能较好完成数字着色,但仍存在两个关键问题:(i) 仅依赖于HE中不显著的像素特征进行着色,易导致信息丢失;(ii) 缺乏像素级精确的HE-IHC真实配对数据,使经典L1损失难以有效应用。为此,本文提出一种基于特征提取器的自适应信息增强着色框架。首先设计VMFE模块,结合多尺度特征提取与小波卷积,有效提取颜色信息特征,并通过共享解码器实现特征融合。采用对比学习训练高性能的双特征提取器,实现高维空间中HE-IHC特征的有效对齐。同时,利用训练好的特征编码器增强特征,并自适应调节染色过程中的损失函数,以解决染色不清和信息不对称问题。在多个数据集上测试均取得优异性能。代码已开源:https://github.com/babyinsunshine/CEFF。
原文摘要 · Abstract (English)
Immunohistochemistry (IHC) staining plays a significant role in the evaluation of diseases such as breast cancer. The H&E-to-IHC transformation based on generative models provides a simple and cost-effective method for obtaining IHC images. Although previous models can perform digital coloring well, they still suffer from (i) coloring only through the pixel features that are not prominent in HE, which is easy to cause information loss in the coloring process; (ii) The lack of pixel-perfect H&E-IHC groundtruth pairs poses a challenge to the classical L1 loss.To address the above challenges, we propose an adaptive information enhanced coloring framework based on feature extractors. We first propose the VMFE module to effectively extract the color information features using multi-scale feature extraction and wavelet transform convolution, while combining the shared decoder for feature fusion. The high-performance dual feature extractor of H&E-IHC is trained by contrastive learning, which can effectively perform feature alignment of HE-IHC in high latitude space. At the same time, the trained feature encoder is used to enhance the features and adaptively adjust the loss in the HE section staining process to solve the problems related to unclear and asymmetric information. We have tested on different datasets and achieved excellent performance.Our code is available at https://github.com/babyinsunshine/CEFF
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。