arXiv:2412.11106eess.IVcs.CV2024-12AAAI被引 7

无需配对样本即可精准虚拟染色,保持病理结构不变。

Unpaired Multi-Domain Histopathology Virtual Staining using Dual Path Prompted Inversion

  • 双路径提示反演:分别控制风格与结构,实现内容与风格解耦。
  • 在多个公开数据集上实现高结构一致性与准确风格迁移。
  • 适合病理图像分析、医学影像生成研究者使用。

虚拟染色通过计算机辅助技术将组织切片的染色样式转移到其他类型染色上。在病理图像虚拟染色中,保持严格的结构一致性至关重要,因病理图像更强调结构完整性,微小结构偏差可能导致诊断语义信息偏离。此外,虚拟染色数据的非配对特性可能损害病理诊断内容的保留。为此,我们提出一种基于提示学习的双路径反演虚拟染色方法,通过优化视觉提示以控制内容与风格,同时完整保留病理诊断信息。该方法包含两个核心组件:(1) 双路径提示策略:利用特征适配函数生成参考图像作为反演的风格模板(风格目标路径),并以输入图像的反演结果作为结构目标路径,通过视觉提示保持结构一致性,同时保留风格路径的信息;在确定性采样过程中,采用即插即用的嵌入式视觉提示实现完全的内容-风格解耦。(2) StainPrompt 优化:仅优化空视觉提示作为“操作符”进行双路径反演,而非微调预训练模型;在每个时间步上优化结构与风格轨迹,确保准确重建。在多个公开的多域无配对染色数据集上的广泛评估表明,该方法实现了高结构一致性和精确风格迁移。

原文摘要 · Abstract (English)

Virtual staining leverages computer-aided techniques to transfer the style of histochemically stained tissue samples to other staining types. In virtual staining of pathological images, maintaining strict structural consistency is crucial, as these images emphasize structural integrity more than natural images. Even slight structural alterations can lead to deviations in diagnostic semantic information. Furthermore, the unpaired characteristic of virtual staining data may compromise the preservation of pathological diagnostic content. To address these challenges, we propose a dual-path inversion virtual staining method using prompt learning, which optimizes visual prompts to control content and style, while preserving complete pathological diagnostic content. Our proposed inversion technique comprises two key components: (1) Dual Path Prompted Strategy, we utilize a feature adapter function to generate reference images for inversion, providing style templates for input image inversion, called Style Target Path. We utilize the inversion of the input image as the Structural Target path, employing visual prompt images to maintain structural consistency in this path while preserving style information from the style Target path. During the deterministic sampling process, we achieve complete content-style disentanglement through a plug-and-play embedding visual prompt approach. (2) StainPrompt Optimization, where we only optimize the null visual prompt as ``operator'' for dual path inversion, rather than fine-tune pre-trained model. We optimize null visual prompt for structual and style trajectory around pivotal noise on each timestep, ensuring accurate dual-path inversion reconstruction. Extensive evaluations on publicly available multi-domain unpaired staining datasets demonstrate high structural consistency and accurate style transfer results.

虚拟染色病理图像双路径提示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。