arXiv:2605.25615cs.CV2026-05被引 1

提出无人机动作识别的视角外泛化评测与自适应方法

UAV-OVO: Out-of-Viewpoint Generalization in UAV Action Recognition

论文配图:UAV-OVO: Out-of-Viewpoint Generalization in UAV Action Recognition
图 1 · 摘自论文原文
  • 构建基于视角分离的评测基准,区分低俯角训练与高俯角测试
  • 发现现有模型在视角变化时性能骤降,暴露视角依赖缺陷
  • 提出LoRA锚定的在线特征重中心化方法,提升跨视角适应能力

无人机动作识别面临部署场景中视角偏移的问题:在低俯角视频上训练的模型需识别高俯角视角下的相同动作。尽管动作标签不变,但人体可见性、运动投影和场景上下文均改变,导致模型依赖视角特有线索。本文提出UAV-OVO,一个面向无人机动作识别的视角外泛化评测基准。该基准通过未校准视频计算视角得分,用视角隔离带将低俯角视频分配至训练和分布内测试集,保留高俯角视频用于分布外测试,并确保类别分布匹配,使性能差异仅反映视角迁移影响。在多个主流视频识别器上,UAV-OVO揭示显著的分布内/外性能差距:模型虽能拟合低俯角训练数据,却难以迁移到未见的高俯角视角,暴露出隐藏的视角捷径。为此,我们进一步提出LATER(LoRA-Anchored Test-time Re-centering),先用低秩适配(LoRA)微调识别器,再以学习到的LoRA子空间作为语义锚点,对目标域特征进行在线重中心化。具体地,将目标域偏移投影至LoRA子空间的正交补空间后再重中心化,有效缓解视角引起的特征漂移,同时保留任务相关语义。UAV-OVO与LATER共同提供可控评估平台与实用适配方法,推动视角鲁棒的无人机视频理解发展。

原文摘要 · Abstract (English)

UAV action recognition faces a deployment shift that standard benchmarks often obscure: a model trained on UAV footage captured from low-depression viewpoints may be required to recognize the same action classes from high-depression viewpoints. While the action labels remain unchanged, this shift alters body visibility, motion projection, and scene context, encouraging models to rely on viewpoint-specific shortcuts. We introduce UAV-OVO, an Out-of-Viewpoint generalization benchmark for UAV action recognition. UAV-OVO derives view scores from uncalibrated videos, uses a view-isolation band to assign low-depression videos to the training and in-distribution test splits while reserving high-depression videos for out-of-distribution testing, and constructs ID/OOD test sets matched by class distribution so that performance differences reflect viewpoint shift rather than label imbalance. Across representative video recognizers, UAV-OVO reveals a substantial ID/OOD gap: models that fit the low-depression training distribution well often fail to transfer to held-out high-depression views, exposing viewpoint shortcuts hidden by aggregate accuracy. We further propose LATER, LoRA-Anchored Test-time Re-centering, which first adapts the recognizer with Low-Rank Adaptation (LoRA) and then uses the learned LoRA subspace as a semantic anchor for online feature re-centering. Specifically, LATER projects target-domain displacement onto the orthogonal complement of the LoRA subspace before re-centering features, reducing viewpoint-induced drift while preserving task-relevant semantics. Together, UAV-OVO and LATER provide a controlled testbed and a practical adaptation method for viewpoint-robust UAV video understanding.

无人机识别视角泛化LoRA自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。