用AI实现无人机柔性机械臂的视觉力控,实时自适应干扰。
AI-Enabled Image-Based Hybrid Vision/Force Control of Tendon-Driven Aerial Continuum Manipulators

- 分层快速固定时间滑模控制+RBF神经网络,在线学习视觉与力感知不确定性。
- 基于图神经网络提取线特征,实现视觉误差与目标力矩的同步调节。
- 无需离线训练,在仿真和实验中均表现鲁棒,适合复杂环境自主操作。
本文提出一种基于$SE(3)$常应变建模的分层混合视觉/力控框架,用于腱驱动空中连续体机械臂。控制器旨在实现与静态环境的自主物理交互,同时稳定图像特征误差。通过结合分层快速固定时间滑模控制与径向基函数神经网络,有效应对眼-手单目相机获取的视觉信息及力传感器测量中的不确定性,实现无需离线训练的快速在线学习。此外,采用先进的图神经网络架构提取线特征,取代传统启发式几何提取器,协同完成期望法向接触力的跟踪与图像特征误差的调节。对比实验在多种初始条件与特征提取策略下验证了方法的有效性,仿真与实测结果均表明其在执行操作任务时具备优异鲁棒性。
原文摘要 · Abstract (English)
This paper presents an AI-enabled cascaded hybrid vision/force control framework for tendon-driven aerial continuum manipulators based on constant-strain modeling in $SE(3)$ as a coupled system. The proposed controller is designed to enable autonomous, physical interaction with a static environment while stabilizing the image feature error. The developed strategy combines the cascaded fast fixed-time sliding mode control and a radial basis function neural network to cope with the uncertainties in the image acquired by the eye-in-hand monocular camera and the measurements from the force sensing apparatus. This ensures rapid, online learning of the vision- and force-related uncertainties without requiring offline training. Furthermore, the features are extracted via a state-of-the-art graph neural network architecture employed by a visual servoing framework using line features, rather than relying on heuristic geometric line extractors, to concurrently contribute to tracking the desired normal interaction force during contact and regulating the image feature error. A comparative study benchmarks the proposed controller against established rigid-arm aerial manipulation methods, evaluating robustness across diverse scenarios and feature extraction strategies. The simulation and experimental results showcase the effectiveness of the proposed methodology under various initial conditions and demonstrate robust performance in executing manipulation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。