arXiv:2601.00391cs.LGcs.CV2026-01被引 42

用深度模型实现无人机视频中实时人体检测,准确率超95%。

Real-Time Human Detection for Aerial Captured Video Sequences via Deep Models

  • 结合光流与三种深度模型,自动学习特征提升检测性能。
  • 预训练CNN达98.09%平均准确率,优于S-CNN和H-ELM。
  • 适合无人机航拍场景下人体检测,可运行于普通CPU上。

人体检测在各类实际应用中至关重要。传统方法依赖手工设计特征,对特定任务有效但易受光照变化、相机抖动及目标尺寸差异影响。相比之下,深度学习可自动提取高抽象性、判别性强的特征,无需专家知识。本文提出一种基于光学流与三种深度模型(监督卷积神经网络S-CNN、预训练CNN特征提取器、分层极限学习机H-ELM)的航拍视频人体检测方法,适用于非静态空中平台且高度变化的场景。模型在公开且极具挑战性的UCF-ARG航拍数据集上进行训练与测试,评估五种人体动作(挖掘、挥手、投掷、行走、跑步)。实验结果表明,该方法有效:预训练CNN平均准确率达98.09%;S-CNN使用Softmax时为95.6%,使用SVM时为91.7%;H-ELM平均准确率为95.9%。在普通中央处理器(CPU)上,H-ELM训练耗时445秒;而使用高性能图形处理器(GPU)时,S-CNN学习需770秒。

原文摘要 · Abstract (English)

Human detection in videos plays an important role in various real-life applications. Most traditional approaches depend on utilizing handcrafted features, which are problem-dependent and optimal for specific tasks. Moreover, they are highly susceptible to dynamical events such as illumination changes, camera jitter, and variations in object sizes. On the other hand, the proposed feature learning approaches are cheaper and easier because highly abstract and discriminative features can be produced automatically without the need of expert knowledge. In this paper, we utilize automatic feature learning methods, which combine optical flow and three different deep models (i.e., supervised convolutional neural network (S-CNN), pretrained CNN feature extractor, and hierarchical extreme learning machine) for human detection in videos captured using a nonstatic camera on an aerial platform with varying altitudes. The models are trained and tested on the publicly available and highly challenging UCF-ARG aerial dataset. The comparison between these models in terms of training, testing accuracy, and learning speed is analyzed. The performance evaluation considers five human actions (digging, waving, throwing, walking, and running). Experimental results demonstrated that the proposed methods are successful for the human detection task. The pretrained CNN produces an average accuracy of 98.09%. S-CNN produces an average accuracy of 95.6% with softmax and 91.7% with Support Vector Machines (SVM). H-ELM has an average accuracy of 95.9%. Using a normal Central Processing Unit (CPU), H-ELM's training time takes 445 seconds. Learning in S-CNN takes 770 seconds with a high-performance Graphical Processing Unit (GPU).

人体检测无人机视频深度学习实时检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。