arXiv:2504.03891eess.SPcs.LG2025-04被引 15

在立方星上用FPGA加速CNN,实现高效云检测。

Efficient FPGA-accelerated Convolutional Neural Networks for Cloud Detection on CubeSats

  • 用FPGA和DPU硬件加速4种CNN模型,适配资源受限卫星。
  • 剪枝后参数减少98.6%,计算量降90.7%,准确率仅降0.6%。
  • 模型实现实时推理,帧率超37FPS,功耗仅2.5W,适合星载应用。

本文实现了四种基于FPGA的卷积神经网络(CNN)模型,用于资源受限的立方星任务中的星载云检测,采用Xilinx Vitis AI(VAI)框架与深度学习处理单元(DPU),该单元是针对深度神经网络优化的可编程引擎,运行于Zynq UltraScale+ MPSoC平台。研究对比了像素级(Pixel-Net和Patch-Net)与图像级(U-Net和Scene-Net)模型,在精度、延迟与模型复杂度之间的权衡。通过通道剪枝,模型参数最多减少98.6%,浮点运算量最多降低90.7%,且精度损失极小。进一步使用VAI工具将模型量化至8位精度,显著提升硬件性能,对精度影响微乎其微。所有模型在部署至FPGA后仍保持高精度,量化与剪枝后累计最大精度下降仅为0.6%。图像级模型Scene-Net和U-Net表现出优异的实时推理能力,分别达到57.14和37.45帧/秒,功耗约2.5W,优于现有星载云检测方案。本方法展示了基于DPU的硬件加速器在拓展小卫星处理能力方面的潜力,支持高效灵活的星载CNN应用。

原文摘要 · Abstract (English)

We present the implementation of four FPGA-accelerated convolutional neural network (CNN) models for onboard cloud detection in resource-constrained CubeSat missions, leveraging Xilinx's Vitis AI (VAI) framework and Deep Learning Processing Unit (DPU), a programmable engine with pre-implemented, parameterizable IP cores optimized for deep neural networks, on a Zynq UltraScale+ MPSoC. This study explores both pixel-wise (Pixel-Net and Patch-Net) and image-wise (U-Net and Scene-Net) models to benchmark trade-offs in accuracy, latency, and model complexity. Applying channel pruning, we achieved substantial reductions in model parameters (up to 98.6%) and floating-point operations (up to 90.7%) with minimal accuracy loss. Furthermore, the VAI tool was used to quantize the models to 8-bit precision, ensuring optimized hardware performance with negligible impact on accuracy. All models retained high accuracy post-FPGA integration, with a cumulative maximum accuracy drop of only 0.6% after quantization and pruning. The image-wise Scene-Net and U-Net models demonstrated strong real-time inference capabilities, achieving frame rates per second of 57.14 and 37.45, respectively, with power consumption of around 2.5 W, surpassing state-of-the-art onboard cloud detection solutions. Our approach underscores the potential of DPU-based hardware accelerators to expand the processing capabilities of small satellites, enabling efficient and flexible onboard CNN-based applications.

FPGA加速星载计算云检测轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。