无需配对图像,用知识蒸馏实现高精度数字染色,提升细胞成像效率。
Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Data
- 用无监督蒸馏框架,分两阶段完成图像增强与着色
- 在未配对和错位配对数据上均实现更精准的细胞结构还原
- 适用于医疗影像,尤其适合难以获取配对数据的场景
染色在细胞成像与医学诊断中至关重要,但存在成本高、耗时长、操作复杂及组织不可逆损伤等问题。深度学习虽可实现数字染色,但大规模精确配对的染色与未染色图像难获取。本文提出一种基于知识蒸馏的无监督数字染色框架,支持无配对和有配对但错位两种情形。针对无配对情况,设计两阶段教师模型(光照增强+色彩化),通过混合无参考损失进行学生模型训练;针对错位配对数据,引入学习对齐模块以利用相邻切片的像素级信息。在自建数据集上的实验表明,该方法在两类设置下均能生成更准确的细胞位置与形态。相比现有方法,本方案在定性和定量指标(如NIQE、PSNR)上均有提升。进一步应用于白细胞(WBC)数据集,验证了其在医疗应用中的潜力。
原文摘要 · Abstract (English)
Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learning have enabled digital staining through supervised model training. However, collecting large-scale, perfectly aligned pairs of stained and unstained images remains difficult. In this work, we propose a novel unsupervised deep learning framework for digital cell staining that reduces the need for extensive paired data using knowledge distillation. We explore two training schemes: (1) unpaired and (2) paired-but-misaligned settings. For the unpaired case, we introduce a two-stage pipeline, comprising light enhancement followed by colorization, as a teacher model. Subsequently, we obtain a student staining generator through knowledge distillation with hybrid non-reference losses. To leverage the pixel-wise information between adjacent sections, we further extend to the paired-but-misaligned setting, adding the Learning to Align module to utilize pixel-level information. Experiment results on our dataset demonstrate that our proposed unsupervised deep staining method can generate stained images with more accurate positions and shapes of the cell targets in both settings. Compared with competing methods, our method achieves improved results both qualitatively and quantitatively (e.g., NIQE and PSNR).We applied our digital staining method to the White Blood Cell (WBC) dataset, investigating its potential for medical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。