用微分方程压缩点云模型,让边缘设备也能高效运行
PointODE: Lightweight Point Cloud Learning with Neural Ordinary Differential Equations on Edge
- 用神经微分方程复用参数,实现轻量点云特征提取
- 0.58M参数模型在真实数据集上精度媲美顶尖方法
- 专为嵌入式FPGA设计加速器,速度提升4.9倍能效更优
边缘设备常用于运行实际点云应用,但现有深度学习方法因资源有限难以部署。本文提出PointODE,一种基于堆叠MLP块与残差连接的轻量级点云特征提取架构。通过引入神经微分方程(Neural ODE),实现跨MLP块的参数复用以压缩模型。针对特征点分布不均问题,提出逐点归一化。进一步设计了参数仅0.58M的PointODE-Elite版本,并开发专用FPGA加速器。该加速器采用四阶段流水线并行处理多点特征,所有参数片上存储,大幅减少外部内存访问。在Xilinx ZCU104板上,相比ARM Cortex-A53 CPU,特征提取速度提升4.9倍,推理速度加快3.7倍,能效提高3.5倍。尽管结构简单,PointODE-Elite在合成与真实世界分类数据集上表现接近当前最优模型,显著优化了精度与推理成本的权衡。
原文摘要 · Abstract (English)
Embedded edge devices are often used as a computing platform to run real-world point cloud applications, but recent deep learning-based methods may not fit on such devices due to limited resources. In this paper, we aim to fill this gap by introducing PointODE, a parameter-efficient ResNet-like architecture for point cloud feature extraction based on a stack of MLP blocks with residual connections. We leverage Neural ODE (Ordinary Differential Equation), a continuous-depth version of ResNet originally developed for modeling the dynamics of continuous-time systems, to compress PointODE by reusing the same parameters across MLP blocks. The point-wise normalization is proposed for PointODE to handle the non-uniform distribution of feature points. We introduce PointODE-Elite as a lightweight version with 0.58M trainable parameters and design its dedicated accelerator for embedded FPGAs. The accelerator consists of a four-stage pipeline to parallelize the feature extraction for multiple points and stores the entire parameters on-chip to eliminate most of the off-chip data transfers. Compared to the ARM Cortex-A53 CPU, the accelerator implemented on a Xilinx ZCU104 board speeds up the feature extraction by 4.9x, leading to 3.7x faster inference and 3.5x better energy-efficiency. Despite the simple architecture, PointODE-Elite shows competitive accuracy to the state-of-the-art models on both synthetic and real-world classification datasets, greatly improving the trade-off between accuracy and inference cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。