通过解耦颜色与结构,实现病理图像的精准染色归一化。
StainPIDR: A Pathological Image Decouplingand Reconstruction Method for Stain Normalization Based on Color Vector Quantization and Structure Restaining
- 分离图像的颜色与结构特征,用目标颜色重染结构。
- 采用固定颜色码本和交叉注意力机制提升重建质量。
- 自动生成最优模板图像,适合临床病理分析场景。
病理图像的颜色表现受成像协议、染料比例和扫描设备影响显著,导致计算机辅助诊断系统性能下降。本文提出一种名为StainPIDR的染色归一化方法,将图像解耦为结构特征与向量量化后的颜色特征,利用目标颜色特征对结构特征进行重染,并解码生成归一化图像。基于同一颜色的图像解耦后颜色特征应完全一致的假设,训练一个固定的颜色向量码本,使解耦颜色特征映射至该码本。重染阶段采用交叉注意力机制高效实现颜色迁移。由于目标颜色(来自选定模板图像)会影响归一化效果,进一步设计了模板图像选择算法,从数据集中自动选取最佳模板。大量实验验证了StainPIDR及模板选择算法的有效性,结果表明该方法在染色归一化任务中表现优异。StainPIDR代码将在后续公开。
原文摘要 · Abstract (English)
The color appearance of a pathological image is highly related to the imaging protocols, the proportion of different dyes, and the scanning devices. Computer-aided diagnostic systems may deteriorate when facing these color-variant pathological images. In this work, we propose a stain normalization method called StainPIDR. We try to eliminate this color discrepancy by decoupling the image into structure features and vector-quantized color features, restaining the structure features with the target color features, and decoding the stained structure features to normalized pathological images. We assume that color features decoupled by different images with the same color should be exactly the same. Under this assumption, we train a fixed color vector codebook to which the decoupled color features will map. In the restaining part, we utilize the cross-attention mechanism to efficiently stain the structure features. As the target color (decoupled from a selected template image) will also affect the performance of stain normalization, we further design a template image selection algorithm to select a template from a given dataset. In our extensive experiments, we validate the effectiveness of StainPIDR and the template image selection algorithm. All the results show that our method can perform well in the stain normalization task. The code of StainPIDR will be publicly available later.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。