用AI把普通病理切片变多色蛋白染色图,解决染色不准、对不齐问题
PGVMS: A Prompt-Guided Unified Framework for Virtual Multiplex IHC Staining with Pathological Semantic Learning
- 通过动态提示引导,让模型理解不同蛋白的染色语义
- 直接约束蛋白分布,保持染色模式与真实一致
- 跨图像关联特征,自动修正多染色空间错位
免疫组化(IHC)可精准检测蛋白质表达,临床有200多种抗体检测可用。但小样本活检常因组织量不足限制全面分析。虚拟多路染色技术可将H&E切片转为多路IHC图像,现有方法仍存在三大瓶颈:(1) 多染色缺乏语义指导,(2) 免疫染色分布不一致,(3) 不同染色模态间空间错位。为此,我们提出仅需单路训练数据的提示引导统一框架(PGVMS)。针对上述挑战,创新性引入三项策略:首先,基于病理视觉语言模型的自适应提示机制,动态调整染色提示以克服语义引导不足(挑战1);其次,蛋白感知学习策略(PALS)通过直接量化与约束蛋白分布,确保表达模式精确(挑战2);第三,原型一致性学习策略(PCLS)建立跨图像语义关联,校正空间错位(挑战3)。
原文摘要 · Abstract (English)
Immunohistochemical (IHC) staining enables precise molecular profiling of protein expression, with over 200 clinically available antibody-based tests in modern pathology. However, comprehensive IHC analysis is frequently limited by insufficient tissue quantities in small biopsies. Therefore, virtual multiplex staining emerges as an innovative solution to digitally transform H&E images into multiple IHC representations, yet current methods still face three critical challenges: (1) inadequate semantic guidance for multi-staining, (2) inconsistent distribution of immunochemistry staining, and (3) spatial misalignment across different stain modalities. To overcome these limitations, we present a prompt-guided framework for virtual multiplex IHC staining using only uniplex training data (PGVMS). Our framework introduces three key innovations corresponding to each challenge: First, an adaptive prompt guidance mechanism employing a pathological visual language model dynamically adjusts staining prompts to resolve semantic guidance limitations (Challenge 1). Second, our protein-aware learning strategy (PALS) maintains precise protein expression patterns by direct quantification and constraint of protein distributions (Challenge 2). Third, the prototype-consistent learning strategy (PCLS) establishes cross-image semantic interaction to correct spatial misalignments (Challenge 3).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。