arXiv:2504.20530cs.CV2025-04AAAI被引 2

针对无人机视角变化难题,提出分层视角建模方法提升动作识别准确率。

Beyond the Horizon: Decoupling Multi-View UAV Action Recognition via Partial Order Transfer

  • 按飞行高度划分视角,分组处理不同视点信息
  • 在无人机数据集上实现4.7%和3.5%的性能提升
  • 适合研究多视角动作识别与无人机视觉应用者

无人机动作识别因垂直方向视角变化大而面临挑战。与地面场景不同,无人机在不同高度拍摄动作,导致外观差异显著。本文针对不同飞行高度设计多视角模型,并实证观察到视角间存在部分顺序关系:随着高度增加,识别准确率持续下降。基于此,提出偏序引导的多视角网络(POG-MVNet),通过三个模块应对视角剧烈变化:视图分割(VP)模块利用头身比按高度分组;有序特征解耦(OFD)模块在部分顺序指导下分离动作相关与视角特有特征;动作偏序引导(APOG)模块将易识别视角的知识迁移至难识别视角。在Drone-Action、MOD20和UAV数据集上实验表明,该方法显著优于ASAT和FAR等先进方法,分别取得4.7%和3.5%的提升。代码即将开源。

原文摘要 · Abstract (English)

Action recognition in unmanned aerial vehicles (UAVs) poses unique challenges due to significant view variations along the vertical spatial axis. Unlike traditional ground-based settings, UAVs capture actions at a wide range of altitudes, resulting in considerable appearance discrepancies. We introduce a multi-view formulation tailored to varying UAV altitudes and empirically observe a partial order among views, where recognition accuracy consistently decreases as altitude increases. This observation motivates a novel approach that explicitly models the hierarchical structure of UAV views to improve recognition performance across altitudes. To this end, we propose the Partial Order Guided Multi-View Network (POG-MVNet), designed to address drastic view variations by effectively leveraging view-dependent information across different altitude levels. The framework comprises three key components: a View Partition (VP) module, which uses the head-to-body ratio to group views by altitude; an Order-aware Feature Decoupling (OFD) module, which disentangles action-relevant and view-specific features under partial order guidance; and an Action Partial Order Guide (APOG), which uses the partial order to transfer informative knowledge from easier views to more challenging ones. We conduct experiments on Drone-Action, MOD20, and UAV, demonstrating that POG-MVNet significantly outperforms competing methods. For example, POG-MVNet achieves a 4.7% improvement on Drone-Action and a 3.5% improvement on UAV compared to state-of-the-art methods ASAT and FAR. Code will be released soon.

动作识别无人机视觉多视角学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。