用FPGA加速的深度学习模型,实现毫秒级无标记细胞实时分类。
Real-Time Cell Sorting with Scalable In Situ FPGA-Accelerated Deep Learning
- 采用师生模型知识蒸馏,学生模型仅占0.02%参数量
- 在8万张图像上实现98%准确率,推理延迟仅14.5μs
- 适合临床快速检测,可部署于普通硬件
精准细胞分类对生物医学诊断和治疗监测至关重要,尤其在识别多种疾病相关细胞类型时。传统流式细胞术依赖分子标记,成本高、耗时长且可能破坏细胞完整性。为此,我们提出一种基于明场显微图像的无标记机器学习框架,适用于实时分选应用。该框架采用教师-学生模型架构并结合知识蒸馏,实现高效可扩展性。以淋巴细胞亚群分类为例,使用8万张预处理图像验证,教师模型在区分T4与B细胞时准确率达98%,零样本分类T8与B细胞达93%。令人瞩目的是,学生模型参数量仅为教师模型的0.02%,可部署于现场可编程门阵列(FPGA)。FPGA加速的学生模型实现仅14.5μs的超低推理延迟,从检测到触发分选总时延为24.7μs,分别比现有最优算法提升12倍和40倍,同时保持与教师模型相当的准确率。该框架为淋巴细胞分类提供可扩展、低成本解决方案,并实现了基于现成硬件的最新一代实时细胞分选技术。
原文摘要 · Abstract (English)
Precise cell classification is essential in biomedical diagnostics and therapeutic monitoring, particularly for identifying diverse cell types involved in various diseases. Traditional cell classification methods such as flow cytometry depend on molecular labeling which is often costly, time-intensive, and can alter cell integrity. To overcome these limitations, we present a label-free machine learning framework for cell classification, designed for real-time sorting applications using bright-field microscopy images. This approach leverages a teacher-student model architecture enhanced by knowledge distillation, achieving high efficiency and scalability across different cell types. Demonstrated through a use case of classifying lymphocyte subsets, our framework accurately classifies T4, T8, and B cell types with a dataset of 80,000 preprocessed images, accessible via an open-source Python package for easy adaptation. Our teacher model attained 98\% accuracy in differentiating T4 cells from B cells and 93\% accuracy in zero-shot classification between T8 and B cells. Remarkably, our student model operates with only 0.02\% of the teacher model's parameters, enabling field-programmable gate array (FPGA) deployment. Our FPGA-accelerated student model achieves an ultra-low inference latency of just 14.5~$μ$s and a complete cell detection-to-sorting trigger time of 24.7~$μ$s, delivering 12x and 40x improvements over the previous state-of-the-art real-time cell analysis algorithm in inference and total latency, respectively, while preserving accuracy comparable to the teacher model. This framework provides a scalable, cost-effective solution for lymphocyte classification, as well as a new SOTA real-time cell sorting implementation for rapid identification of subsets using in situ deep learning on off-the-shelf computing hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。