压缩RNN模型,让荧光寿命成像在FPGA上实时运行
Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imaging
- 用知识蒸馏等技术压缩RNN,减小模型体积
- 8位精度下参数量降98%仍保持准确率
- 适合资源受限的FPGA部署,支持实时生物分析
荧光寿命成像(FLI)是研究细胞环境和分子相互作用的重要技术,但其实时应用受限于数据采集慢,需捕获大量时间分辨图像并进行复杂迭代拟合后处理。深度学习模型可实现实时推理,但因架构复杂、矩阵运算量大,难以直接部署于基于FPGA的相机硬件。为此,本文聚焦于压缩适用于FLI时序数据处理的循环神经网络(RNN),以适配资源受限的FPGA平台。我们对权重削减、知识蒸馏(KD)、训练后量化(PTQ)及量化感知训练(QAT)等多种压缩技术进行实证评估,在降低模型尺寸与计算负载的同时保持推理精度。所提出的压缩模型Seq2SeqLite在8位精度下表现优异,通过KD使参数量减少98%,同时保留性能,可在数据采集过程中实现并发实时FLI分析。该工作推动了硬件加速实时FLI分析在快速生物过程研究中的落地。
原文摘要 · Abstract (English)
Fluorescence lifetime imaging (FLI) is an important technique for studying cellular environments and molecular interactions, but its real-time application is limited by slow data acquisition, which requires capturing large time-resolved images and complex post-processing using iterative fitting algorithms. Deep learning (DL) models enable real-time inference, but can be computationally demanding due to complex architectures and large matrix operations. This makes DL models ill-suited for direct implementation on field-programmable gate array (FPGA)-based camera hardware. Model compression is thus crucial for practical deployment for real-time inference generation. In this work, we focus on compressing recurrent neural networks (RNNs), which are well-suited for FLI time-series data processing, to enable deployment on resource-constrained FPGA boards. We perform an empirical evaluation of various compression techniques, including weight reduction, knowledge distillation (KD), post-training quantization (PTQ), and quantization-aware training (QAT), to reduce model size and computational load while preserving inference accuracy. Our compressed RNN model, Seq2SeqLite, achieves a balance between computational efficiency and prediction accuracy, particularly at 8-bit precision. By applying KD, the model parameter size was reduced by 98\% while retaining performance, making it suitable for concurrent real-time FLI analysis on FPGA during data capture. This work represents a big step towards integrating hardware-accelerated real-time FLI analysis for fast biological processes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。