用无标签显微图像同时识别血细胞类型和蛋白表达水平
Towards Label-Free Single-Cell Phenotyping Using Multi-Task Learning

- 融合卷积与Transformer的混合模型,从相位差图像中提取形态与分子特征
- 在BSCCM数据集上实现91.3%分类准确率和0.72的蛋白表达相关性
- 结合大语言模型生成生物学可解释报告,适合临床影像分析场景
无标签单细胞成像提供了可扩展、非侵入式的替代方案,但直接从明场形态推断分子表型仍具挑战。我们提出一种统一的深度学习框架,联合完成白细胞分类与连续蛋白表达回归任务,输入为无标签的差分相位对比(DPC)图像。模型采用混合架构,通过可学习的跨分支门控模块融合卷积网络的细粒度纹理特征与Transformer的全局表征,实现对DPC图像的鲁棒形态-分子推断。为进一步支持下游可解释性,引入大型语言模型(LLM),自动生成简洁且符合生物学背景的细胞状态摘要。在伯克利单细胞计算显微镜(BSCCM)与血液细胞图像基准测试中表现优异,达成91.3%的白细胞分类准确率和0.72的CD16表达回归皮尔逊相关系数。结果表明,该方法有望实现低成本血液表型分析,无需荧光染色即可同步识别表型与定量生物标志物。源代码已公开于https://github.com/saqibnaziir/Single-Cell-Phenotyping。
原文摘要 · Abstract (English)
Label-free single-cell imaging offers a scalable, non-invasive alternative to fluorescence-based cytometry, yet inferring molecular phenotypes directly from bright-field morphology remains challenging. We present a unified Deep Learning (DL) framework that jointly performs White Blood Cell (WBC) classification and continuous protein-expression regression from label-free Differential Phase Contrast (DPC) images. Our model employs a Hybrid architecture that fuses convolutional fine-grained texture features with transformer-based global representations through a learnable cross-branch gating module, enabling robust morpho-molecular inference from DPC images. To support downstream interpretability, we further incorporate a Large Language Model (LLM) that generates concise, biologically grounded summaries of the predicted cell states. Experiments on the Berkeley Single Cell Computational Microscopy (BSCCM) and Blood Cells Image benchmarks demonstrate strong performance, achieving a 91.3% WBC classification accuracy and a 0.72 Pearson correlation for CD16 expression regression on BSCCM. These results underscore the promise of label-free single-cell imaging for cost-effective hematological profiling, enabling simultaneous phenotype identification and quantitative biomarker estimation without fluorescent staining. The source code is available at https://github.com/saqibnaziir/Single-Cell-Phenotyping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。