用结构先验指导虚拟免疫组化生成,提升病理一致性。
PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry
- 先建组织结构图再逐步生成分子表达,避免语义错乱
- 在IHC4BC和MIST数据集上结构保真度优于现有方法
- 适合需高精度分子模拟的病理分析与数字病理研究
虚拟免疫组化(Virtual IHC)旨在从常规苏木精-伊红(H&E)图像中计算合成分子染色模式,为传统物理染色提供低成本、少组织消耗的替代方案。然而该任务极具挑战:H&E形态提供的蛋白表达线索模糊,相似组织结构可能对应不同分子状态。现有方法多采用直接外观合成实现跨模态生成,常因缺乏结构先验导致语义不一致。本文提出病理感知集成下一尺度变换(PAINT),一种视觉自回归框架,将合成过程重构为结构优先的条件生成任务。不同于直接图像转换,PAINT通过全局结构布局约束分子细节生成,遵循因果顺序。核心是引入空间结构起始图(3S-Map),以观测形态为基础初始化自回归过程,确保生成结果确定且空间对齐。在IHC4BC与MIST数据集上的实验表明,PAINT在结构保真度及临床下游任务中均优于当前最优方法,验证了结构引导自回归建模的有效性。
原文摘要 · Abstract (English)
Virtual immunohistochemistry (IHC) aims to computationally synthesize molecular staining patterns from routine Hematoxylin and Eosin (H\&E) images, offering a cost-effective and tissue-efficient alternative to traditional physical staining. However, this task is particularly challenging: H\&E morphology provides ambiguous cues about protein expression, and similar tissue structures may correspond to distinct molecular states. Most existing methods focus on direct appearance synthesis to implicitly achieve cross-modal generation, often resulting in semantic inconsistencies due to insufficient structural priors. In this paper, we propose Pathology-Aware Integrated Next-Scale Transformation (PAINT), a visual autoregressive framework that reformulates the synthesis process as a structure-first conditional generation task. Unlike direct image translation, PAINT enforces a causal order by resolving molecular details conditioned on a global structural layout. Central to this approach is the introduction of a Spatial Structural Start Map (3S-Map), which grounds the autoregressive initialization in observed morphology, ensuring deterministic, spatially aligned synthesis. Experiments on the IHC4BC and MIST datasets demonstrate that PAINT outperforms state-of-the-art methods in structural fidelity and clinical downstream tasks, validating the potential of structure-guided autoregressive modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。