解决弱配对下H&E图像生成虚拟IHC时的语义不一致问题
USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining
- 通过非对齐特征传输捕捉全局形态语义,避免依赖位置对应
- 在两个公开数据集上实现更高的交并率和皮尔逊相关性
- 适合病理图像分析、医学影像生成领域研究人员使用
免疫组织化学(IHC)虚拟染色旨在从H&E图像生成与相邻切片病理语义一致的虚拟IHC图像,通过生成模型实现形态结构与染色模式之间的跨域映射,为病理分析提供高效低成本方案。然而,在弱配对条件下,相邻切片的空间异质性带来显著挑战,易导致一对多映射不准,生成结果与邻近切片病理语义不一致。为此,本文提出新型无平衡自信息特征传输方法USIGAN,无需依赖位置对应即可提取全局形态语义。通过消除联合边缘分布中的弱配对项,有效缓解弱配对对联合分布的影响,显著提升生成结果的内容一致性和病理语义一致性。设计了无平衡最优传输一致性(UOT-CTM)机制与病理自对应(PC-SCM)机制,分别构建图像级及组内真实IHC与生成IHC间的相关矩阵。在两个公开数据集上的实验表明,该方法在多个临床重要指标(如IoD、Pearson-R相关性)上表现更优,具备更强临床相关性。
原文摘要 · Abstract (English)
Immunohistochemical (IHC) virtual staining is a task that generates virtual IHC images from H\&E images while maintaining pathological semantic consistency with adjacent slices. This task aims to achieve cross-domain mapping between morphological structures and staining patterns through generative models, providing an efficient and cost-effective solution for pathological analysis. However, under weakly paired conditions, spatial heterogeneity between adjacent slices presents significant challenges. This can lead to inaccurate one-to-many mappings and generate results that are inconsistent with the pathological semantics of adjacent slices. To address this issue, we propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN, which extracts global morphological semantics without relying on positional correspondence.By removing weakly paired terms in the joint marginal distribution, we effectively mitigate the impact of weak pairing on joint distributions, thereby significantly improving the content consistency and pathological semantic consistency of the generated results. Moreover, we design the Unbalanced Optimal Transport Consistency (UOT-CTM) mechanism and the Pathology Self-Correspondence (PC-SCM) mechanism to construct correlation matrices between H\&E and generated IHC in image-level and real IHC and generated IHC image sets in intra-group level.. Experiments conducted on two publicly available datasets demonstrate that our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。