arXiv:2604.08305eess.IVcs.AI2026-04中稿 · ICPR 2026被引 1

HistDiT用新架构实现高保真虚拟染色,解决结构与纹理的平衡难题。

HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology

论文配图:HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
图 1 · 摘自论文原文
  • 采用双流条件机制,分别约束空间结构和生物表型特征。
  • 多目标损失使生成图像更清晰,形态结构更准确。
  • 引入结构相关性度量,精准评估染色质量,适合病理诊断场景。

免疫组化(IHC)对乳腺癌中人类表皮生长因子受体2(HER2)等生物标志物评估至关重要。然而传统IHC流程耗时耗资,易造成组织结构损伤。虚拟染色作为可扩展替代方案,仍面临保留细粒度细胞结构与准确转译生化表达之间的挑战。现有先进方法依赖生成对抗网络(GANs)或标准卷积U-Net扩散模型,常出现‘结构与染色权衡’问题:生成样本或结构合理但模糊,或纹理逼真但含伪影,影响诊断可用性。本文提出HistDiT,一种新型潜在条件扩散Transformer(DiT)架构,在虚拟组织染色视觉保真度上建立新基准。创新点包括:a) 双流条件策略,通过VAE编码潜变量维持空间约束,利用UNI嵌入提供语义表型引导;b) 多目标损失函数,提升图像锐度与形态清晰度;c) 采用结构相关性度量(SCM),聚焦核心形态结构以精确评估样本质量。实验表明,该模型在定量与定性评估中均优于现有基线。

原文摘要 · Abstract (English)

Immunohistochemistry (IHC) is essential for assessing specific immune biomarkers like Human Epidermal growth-factor Receptor 2 (HER2) in breast cancer. However, the traditional protocols of obtaining IHC stains are resource-intensive, time-consuming, and prone to structural damages. Virtual staining has emerged as a scalable alternative, but it faces significant challenges in preserving fine-grained cellular structures while accurately translating biochemical expressions. Current state-of-the-art methods still rely on Generative Adversarial Networks (GANs) or standard convolutional U-Net diffusion models that often struggle with "structure and staining trade-offs". The generated samples are either structurally relevant but blurry, or texturally realistic but have artifacts that compromise their diagnostic use. In this paper, we introduce HistDiT, a novel latent conditional Diffusion Transformer (DiT) architecture that establishes a new benchmark for visual fidelity in virtual histological staining. The novelty introduced in this work is, a) the Dual-Stream Conditioning strategy that explicitly maintains a balance between spatial constraints via VAE-encoded latents and semantic phenotype guidance via UNI embeddings; b) the multi-objective loss function that contributes to sharper images with clear morphological structure; and c) the use of the Structural Correlation Metric (SCM) to focus on the core morphological structure for precise assessment of sample quality. Consequently, our model outperforms existing baselines, as demonstrated through rigorous quantitative and qualitative evaluations.

虚拟染色扩散模型病理图像Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。