对比FPGA与GPU加速特征检测,发现学习型检测器在FPGA上更高效。
Accelerated Feature Detectors for Visual SLAM: A Comparative Study of FPGA vs GPU
- 比较GPU与FPGA加速FAST、Harris和SuperPoint特征检测器的性能表现
- SuperPoint在FPGA上实现速度提升3.1倍、能效提升1.4倍
- FPGA加速的V-SLAM在部分数据集上帧率更高,适合低功耗场景
特征检测是视觉SLAM中常见但耗时的模块,尤其在无人机等功耗受限平台中。本文首次系统比较了现代SoC(Nvidia Jetson Orin与AMD Versal)上FPGA与GPU加速的特征检测器在视觉SLAM流程中的表现。结果表明:对于非学习型检测器如FAST和Harris,GPU实现的运行效率和能效均优于FPGA;但对于学习型检测器SuperPoint,其FPGA实现的速度和能效分别提升3.1倍和1.4倍。FPGA加速的V-SLAM在5个数据集序列中有2个达到更高帧率,与GPU版本性能相当。尽管整体上GPU加速的V-SLAM精度更高,但硬件加速可减少全局束调整调用频率,在不损失精度的前提下进一步提升系统性能。
原文摘要 · Abstract (English)
Feature detection is a common yet time-consuming module in Simultaneous Localization and Mapping (SLAM) implementations, which are increasingly deployed on power-constrained platforms, such as drones. Graphics Processing Units (GPUs) have been a popular accelerator for computer vision in general, and feature detection and SLAM in particular. On the other hand, System-on-Chips (SoCs) with integrated Field Programmable Gate Array (FPGA) are also widely available. This paper presents the first study of hardware-accelerated feature detectors considering a Visual SLAM (V-SLAM) pipeline. We offer new insights by comparing the best GPU-accelerated FAST, Harris, and SuperPoint implementations against the FPGA-accelerated counterparts on modern SoCs (Nvidia Jetson Orin and AMD Versal). The evaluation shows that when using a non-learning-based feature detector such as FAST and Harris, their GPU implementations, and the GPU-accelerated V-SLAM can achieve better run-time performance and energy efficiency than the FAST and Harris FPGA implementations as well as the FPGA-accelerated V-SLAM. However, when considering a learning-based detector such as SuperPoint, its FPGA implementation can achieve better run-time performance and energy efficiency (up to 3.1$\times$ and 1.4$\times$ improvements, respectively) than the GPU implementation. The FPGA-accelerated V-SLAM can also achieve comparable run-time performance compared to the GPU-accelerated V-SLAM, with better FPS in 2 out of 5 dataset sequences. When considering the accuracy, the results show that the GPU-accelerated V-SLAM is more accurate than the FPGA-accelerated V-SLAM in general. Last but not least, the use of hardware acceleration for feature detection could further improve the performance of the V-SLAM pipeline by having the global bundle adjustment module invoked less frequently without sacrificing accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。