arXiv:2510.19273cs.CV2025-10

轻量级模型实现微型无人机动作高效识别,速度翻倍且精度高。

MobiAct: Efficient MAV Action Recognition Using MobileNetV4 with Contrastive Learning and Knowledge Distillation

  • 用MobileNetV4+分阶段正交知识蒸馏提升小模型性能。
  • 在三组自建数据集上达92.12%准确率,每秒处理8.84个动作。
  • 无参数注意力机制+混合损失,适合资源受限的无人机平台。

精准高效的微型飞行器(MAV)动作识别对自主空中集群的实时感知与协同至关重要。然而现有方法多依赖计算量大的模型,难以在资源受限的MAV平台上运行,导致精度与速度难以兼顾。为此,本文提出轻量级框架MobiAct,采用MobileNetV4作为主干网络,引入分阶段正交知识蒸馏(SOKD)策略,将ResNet18教师模型中的运动特征高效迁移到学生模型中,提升知识迁移效率;同时集成无参数注意力机制,在不增加复杂度的前提下提高识别精度;此外设计混合损失训练策略,确保训练过程稳定可靠。实验表明,MobiAct在三个自建数据集上平均识别准确率达92.12%,仅消耗136.16 pJ能量,以每秒8.84个动作的速度完成识别,比领先方法快2倍,兼具高精度与极低能耗,显著提升MAV动作识别效率。

原文摘要 · Abstract (English)

Accurate and efficient recognition of Micro Air Vehicle (MAV) motion is essential for enabling real-time perception and coordination in autonomous aerial swarm. However, most existing approaches rely on large, computationally intensive models that are unsuitable for resource-limited MAV platforms, which results in a trade-off between recognition accuracy and inference speed. To address these challenges, this paper proposes a lightweight MAV action recognition framework, MobiAct, designed to achieve high accuracy with low computational cost. Specifically, MobiAct adopts MobileNetV4 as the backbone network and introduces a Stage-wise Orthogonal Knowledge Distillation (SOKD) strategy to effectively transfer MAV motion features from a teacher network (ResNet18) to a student network, thereby enhancing knowledge transfer efficiency. Furthermore, a parameter-free attention mechanism is integrated into the architecture to improve recognition accuracy without increasing model complexity. In addition, a hybrid loss training strategy is developed to combine multiple loss objectives, which ensures stable and robust optimization during training. Experimental results demonstrate that the proposed MobiAct achieves low-energy and low-computation MAV action recognition, while maintaining the fastest action decoding speed among compared methods. Across all three self-collected datasets, MobiAct achieves an average recognition accuracy of 92.12%, while consuming only 136.16 pJ of energy and processing recognition at a rate of 8.84 actions per second. Notably, MobiAct decodes actions up to 2 times faster than the leading method, with highly comparable recognition accuracy, highlighting its superior efficiency in MAV action recognition.

无人机识别轻量模型知识蒸馏边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。