用边缘GPU加速人脸检测与识别,帧率超290,省电800毫瓦。
Edge-GPU Based Face Tracking for Face Detection and Recognition Acceleration
- 全硬件引擎并行处理,突破传统只用CPU或GPU核心的局限。
- 加入追踪模块,仅在新脸出现时运行识别,提升效率至290帧/秒。
- 适合部署于公共区域多摄像头监控系统,兼顾性能与能耗。
面向公共场所实时精准的人脸检测与识别,低成本机器视觉系统至关重要。尽管专用边缘或云端AI加速器性能优异,但在吞吐量与功耗方面仍有优化空间。本文提出一种软硬件协同方案,针对最新边缘GPU NVIDIA Jetson AGX Orin,充分利用其全部硬件引擎实现并行处理,显著缩短处理时间。同时引入人脸追踪模块,避免每帧重复运行识别算法,仅在新脸出现时触发。实验表明,该方案在1920×1080输入分辨率、平均每帧6张人脸条件下,达到290帧/秒的惊人吞吐量,相较仅使用CPU/GPU且无追踪的方案,功耗降低约800毫瓦。此硬件-软件协同设计为边缘高精度视频监控系统提供了可行路径,尤其适用于多个摄像头协同覆盖同一场景的公共安全应用。
原文摘要 · Abstract (English)
Cost-effective machine vision systems dedicated to real-time and accurate face detection and recognition in public places are crucial for many modern applications. However, despite their high performance, which could be reached using specialized edge or cloud AI hardware accelerators, there is still room for improvement in throughput and power consumption. This paper aims to suggest a combined hardware-software approach that optimizes face detection and recognition systems on one of the latest edge GPUs, namely NVIDIA Jetson AGX Orin. First, it leverages the simultaneous usage of all its hardware engines to improve processing time. This offers an improvement over previous works where these tasks were mainly allocated automatically and exclusively to the CPU or, to a higher extent, to the GPU core. Additionally, the paper suggests integrating a face tracker module to avoid redundantly running the face recognition algorithm for every frame but only when a new face appears in the scene. The results of extended experiments suggest that simultaneous usage of all the hardware engines that are available in the Orin GPU and tracker integration into the pipeline yield an impressive throughput of 290 FPS (frames per second) on 1920 x 1080 input size frames containing in average of 6 faces/frame. Additionally, a substantial saving of power consumption of around 800 mW was achieved when compared to running the task on the CPU/GPU engines only and without integrating a tracker into the Orin GPU\'92s pipeline. This hardware-codesign approach can pave the way to design high-performance machine vision systems at the edge, critically needed in video monitoring in public places where several nearby cameras are usually deployed for a same scene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。