用小模型自监督学习大模型,实现无地标实时无人机视觉控制。
Efficient Self-Supervised Neuro-Analytic Visual Servoing for Real-time Quadrotor Control
- 小模型通过知识蒸馏从解析式控制器学动作
- 推理速度提升11倍,计算量大幅降低
- 适合无GPS室内环境的轻量级无人机部署
本文提出一种自监督神经-解析视觉伺服控制方法,用于基于视觉的四旋翼无人机实时控制。采用仅170万参数的小型学生卷积网络,通过知识蒸馏从一个改进的基于图像的视觉伺服(IBVS)教师模型中自动学习。该IBVS系统通过简化经典视觉伺服方程,解决了数值不稳定性问题,并实现了高效的稳定图像特征检测。学生模型在推理速度上比教师管道快11倍,同时保持相近控制精度,且显著降低计算与内存开销。所提纯视觉自监督神经-解析控制无需显式几何模型或标识标记,即可实现无人机姿态与运动控制。方法利用仿真到现实的迁移学习,在无GPS的室内环境中于小型无人机平台完成验证。主要贡献包括:(1) 一种解决经典方法固有数值不稳定的解析式IBVS教师模型;(2) 一种两阶段分割流水线,结合YOLOv11与基于U-Net的掩码分割器,实现鲁棒的前后方向车辆分割,准确估计目标朝向;(3) 一种高效的知识蒸馏双路径系统,将几何视觉伺服能力从解析式教师模型迁移到紧凑的学生神经网络,使其性能超越教师模型,且适用于实时机载部署。
原文摘要 · Abstract (English)
This work introduces a self-supervised neuro-analytical, cost efficient, model for visual-based quadrotor control in which a small 1.7M parameters student ConvNet learns automatically from an analytical teacher, an improved image-based visual servoing (IBVS) controller. Our IBVS system solves numerical instabilities by reducing the classical visual servoing equations and enabling efficient stable image feature detection. Through knowledge distillation, the student model achieves 11x faster inference compared to the teacher IBVS pipeline, while demonstrating similar control accuracy at a significantly lower computational and memory cost. Our vision-only self-supervised neuro-analytic control, enables quadrotor orientation and movement without requiring explicit geometric models or fiducial markers. The proposed methodology leverages simulation-to-reality transfer learning and is validated on a small drone platform in GPS-denied indoor environments. Our key contributions include: (1) an analytical IBVS teacher that solves numerical instabilities inherent in classical approaches, (2) a two-stage segmentation pipeline combining YOLOv11 with a U-Net-based mask splitter for robust anterior-posterior vehicle segmentation to correctly estimate the orientation of the target, and (3) an efficient knowledge distillation dual-path system, which transfers geometric visual servoing capabilities from the analytical IBVS teacher to a compact and small student neural network that outperforms the teacher, while being suitable for real-time onboard deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。