用物理仿真生成真实感激光点云,实现边缘设备实时3D分类。
Synthetic LiDAR Data Generation and Deterministic Downsampling for Point Cloud Classification on the Edge

- 基于物理仿真构建合成激光数据集,弥补真实与虚拟数据差距。
- 预训练关键点层将1024点压缩至40-60个坐标,提升处理效率。
- 在树莓派5上实现约50帧/秒推理,准确率达88.36%,适合边缘部署。
将三维深度学习框架部署于低功耗嵌入式处理器面临两大瓶颈:空间数据的非结构化特性,以及神经网络推理前常用的距离排序算法资源开销大。本文提出一种面向树莓派5硬件约束的优化流程。为弥合无噪声、干净的计算机辅助设计(CAD)数据集与真实传感器数据间的现实差距,采用物理基仿真构建合成激光雷达数据集。跨数据集评估显示,仅在干净CAD数据上训练的模型在合成激光雷达数据上分类准确率大幅下降,凸显传感器感知训练的重要性。为解决传统几何预处理在边缘CPU上的延迟瓶颈,引入独立的、特征驱动的关键点层(CPL)作为前端过滤器。结果表明,预训练的CPL可确定性地将原始1024点云压缩至40至60个唯一坐标。在ARM Cortex-A76处理器上测试,整个流水线实现约50帧/秒的推理吞吐量,同时保持88.36%的实例分类准确率,验证了在边缘端实现确定性实时3D感知的可行性。
原文摘要 · Abstract (English)
Deploying three-dimensional deep learning frameworks to low-power embedded processors is bottlenecked by the unstructured nature of spatial data and the resource-intensive distance sorting algorithms often used before neural network inference. To address this gap, this paper presents a hardware-constrained workflow optimized for native execution on the Raspberry Pi 5. To account for the reality gap between noiseless, clean computer-aided design (CAD) datasets and real-world sensor data, we use physics-based simulation to construct a synthetic LiDAR dataset. Cross-dataset evaluations demonstrate a substantial drop in classification accuracy when networks trained on clean CAD data are evaluated on synthetic LiDAR sensor data, highlighting the critical need for sensor-aware training. To address the latency bottleneck of traditional geometric preprocessing on edge CPUs, we integrate an isolated, feature-driven Critical Points Layer (CPL) as a frontend filter. Our results show that the pretrained CPL deterministically compresses raw 1024-point clouds to a subset of 40 to 60 unique coordinates. When profiled on the ARM Cortex-A76 processor, the complete pipeline achieves an inference throughput of approximately 50 FPS while maintaining an instance classification accuracy of 88.36%, demonstrating the viability of deterministic real-time 3D perception at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。