用运动归一化时序特征实现低功耗无人机实时人追踪
Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware

- 通过运动归一化生成时序特征,避免依赖复杂时序模型
- 在树莓派零上实现31.85帧/秒,精度达0.462 AP25
- 适合资源受限的嵌入式无人机场景,尤其关注低功耗部署
跟随式人追踪必须在无人机本地运行,而低成本计算设备仅提供数个有效int8 GFLOP/s。在典型跟随距离下,人体仅占10-60像素,难以与背景杂波区分,单帧外观检测无法胜任。关键证据存在于时序信息中,应以解析方式纳入输入表示,而非依赖学习型时序模块。EMTS-Det为五阶段系统:估计自运动,将每帧转换为自运动归一化的残差运动通道,使用22k参数、7.6-MFLOP网络检测人体中心,基于卡尔曼滤波在稳定坐标系中跟踪目标,并用一维卷积分类器验证轨迹(ROC AUC 0.941)。训练采用合成运动课程,运动通道由部署的自运动代码生成。多种子消融实验表明泛化价值:在未见的VisDrone-DET上,仅亮度通道变体准确率降至0.051 AP25,YOLOv8n微调后同样降至0.051(尽管计算量高出1100倍),而部署的int8检测器在域内达0.694 AP25,跨数据集仍保持0.444。时序移位模块降低性能,因此部署模型为无状态。记录到静默int8校准失败;最小-最大校准结合传播缓存可使精度与浮点模型相差小于0.008 AP。在Raspberry Pi Zero 2W上,该流水线在1000段真实无人机视频上运行于31.85 FPS,AP25为0.462,召回率达0.714,相较YOLOv8n的1.95 FPS和0.172 AP25显著提升。一段57秒实地序列显示自动锁定仅需1.3秒,锁住召回率97.9%,在九次遮挡后均成功恢复且无误重锁。
原文摘要 · Abstract (English)
Follow-me person tracking must run on the drone itself, where affordable companion computers offer only a few effective int8 GFLOP/s. At typical follow distances a person spans 10-60 pixels, indistinguishable from clutter and beyond the reach of single-frame appearance detectors. The missing evidence is temporal and belongs in the input representation, computed analytically, rather than in learned temporal machinery. EMTS-Det is a five-stage system that estimates ego-motion, converts each frame into ego-motion-normalized residual-motion channels, detects person centers with a 22k-parameter, 7.6-MFLOP network, tracks a locked target with a Kalman filter in stabilized coordinates, and verifies tracks with a 1-D convolutional classifier of human motion (ROC AUC 0.941). Training uses a synthetic-motion curriculum with motion channels generated by the deployed ego-motion code. Multi-seed ablations locate the value in generalization: on held-out VisDrone-DET a luminance-only variant collapses to 0.051 AP25 versus 0.415, as does YOLOv8n fine-tuned identically despite 1,100 times the compute, while the deployed int8 detector reaches 0.694 AP25 in-domain and 0.444 on this split. Temporal-shift modules lower accuracy, so the deployed detector is stateless. Silent int8 calibration failures are documented; min-max calibration with propagated caches matches float within 0.008 AP. On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos, versus 1.95 FPS and 0.172 AP25 for YOLOv8n. A 57-second field sequence shows auto-lock at 1.3 s, 97.9% lock recall, and recovery from all nine occlusions with zero false re-locks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。