arXiv:2506.14449cs.LGphysics.optics2025-06被引 2

用深度学习分析无标记荧光图像,自动识别免疫细胞类型。

Detecting immune cells with label-free two-photon autofluorescence and deep learning

  • 基于自体荧光的无标记双光子成像,输入深度学习模型进行分类。
  • 二分类任务中准确率高达0.89 ROC-AUC,六类分类任务中F1达0.683。
  • 模型不依赖外部环境,且两种荧光信号(NADH/FAD)均关键,适合活体应用。

无标记成像因无需复杂染色而备受关注,尤其适用于活体应用。无标记多光子显微镜(MPM)利用天然代谢蛋白的双光子激发自体荧光(AF),适合活体内窥成像。深度学习(DL)已在其他光学成像中用于预测目标标注,提升无标记图像的特异性,但鲜有应用于MPM。本文使用包含5,075个细胞的混合样本数据集进行二分类,以及3,424个细胞的独立样本多分类任务,训练卷积神经网络(CNN)基于无标记自体荧光分类免疫细胞类型。采用低复杂度SqueezeNet架构,在混合样本二分类中达到0.89 ROC-AUC和0.95 PR-AUC;在孤立样本六类分类中实现0.683 F1分数、0.697精确率、0.748召回率和0.683马修相关系数。扰动测试表明模型不受胞外环境干扰,且输入的NADH与FAD通道贡献相当。未来该模型可直接在未染色图像中预测特定免疫细胞,计算增强无标记MPM的特异性,对活体内窥成像具有重要潜力。

原文摘要 · Abstract (English)

Label-free imaging has gained broad interest because of its potential to omit elaborate staining procedures which is especially relevant for in vivo use. Label-free multiphoton microscopy (MPM), for instance, exploits two-photon excitation of natural autofluorescence (AF) from native, metabolic proteins, making it ideal for in vivo endomicroscopy. Deep learning (DL) models have been widely used in other optical imaging technologies to predict specific target annotations and thereby digitally augment the specificity of these label-free images. However, this computational specificity has only rarely been implemented for MPM. In this work, we used a data set of label-free MPM images from a series of different immune cell types (5,075 individual cells for binary classification in mixed samples and 3,424 cells for a multi-class classification task) and trained a convolutional neural network (CNN) to classify cell types based on this label-free AF as input. A low-complexity squeezeNet architecture was able to achieve reliable immune cell classification results (0.89 ROC-AUC, 0.95 PR-AUC, for binary classification in mixed samples; 0.689 F1 score, 0.697 precision, 0.748 recall, and 0.683 MCC for six-class classification in isolated samples). Perturbation tests confirmed that the model is not confused by extracellular environment and that both input AF channels (NADH and FAD) are about equally important to the classification. In the future, such predictive DL models could directly detect specific immune cells in unstained images and thus, computationally improve the specificity of label-free MPM which would have great potential for in vivo endomicroscopy.

免疫细胞无标记成像深度学习双光子显微

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。