arXiv:2604.22724cs.ROcs.SY2026-04中稿 · publication at the…

用优化轨迹生成高质量示范数据,训练高效可控的机器人策略。

GCImOpt: Learning efficient goal-conditioned policies by imitating optimal trajectories

论文配图:GCImOpt: Learning efficient goal-conditioned policies by imitating optimal trajectories
图 1 · 摘自论文原文
  • 用轨迹优化生成最优示范,可在笔记本上分钟级产出数千条
  • 策略参数少于8万,比优化求解器快6000倍以上
  • 适用于机械臂、四旋翼等多类控制任务,适合嵌入式部署

模仿学习是机器学习控制的经典方法,但依赖昂贵或低质的示范数据。本文提出GCImOpt,通过轨迹优化生成高质量示范数据集。该方法计算高效,可在笔记本电脑上分钟内生成数千条最优轨迹。通过将中间状态作为目标进行数据增强,训练数据量扩大一个数量级。基于此数据,训练出可控制到任意目标的神经网络策略。在小车平衡、平面及三维四旋翼稳定、6-自由度机械臂点位到达等任务中,策略均达到高成功率和近最优控制效果,模型参数少于80,000,推理速度超过优化求解器6,000倍,具备在资源受限控制器上部署的能力。代码、数据集与预训练模型已开源。

原文摘要 · Abstract (English)

Imitation learning is a well-established approach for machine-learning-based control. However, its applicability depends on having access to demonstrations, which are often expensive to collect and/or suboptimal for solving the task. In this work, we present GCImOpt, an approach to learn efficient goal-conditioned policies by training on datasets generated by trajectory optimization. Our approach for dataset generation is computationally efficient, can generate thousands of optimal trajectories in minutes on a laptop computer, and produces high-quality demonstrations. Further, by means of a data augmentation scheme that treats intermediate states as goals, we are able to increase the training dataset size by an order of magnitude. Using our generated datasets, we train goal-conditioned neural network policies that can control the system towards arbitrary goals. To demonstrate the generality of our approach, we generate datasets and then train policies for various control tasks, namely cart-pole stabilization, planar and three-dimensional quadcopter stabilization, and point reaching using a 6-DoF robot arm. We show that our trained policies can achieve high success rates and near-optimal control profiles, all while being small (less than 80,000 neural network parameters) and fast enough (up to more than 6,000 times faster than a trajectory optimization solver) that they could be deployed onboard resource-constrained controllers. We provide videos, code, datasets and pre-trained policies under a free software license; see our project website https://jongoiko.github.io/gcimopt/.

模仿学习轨迹优化机器人控制高效策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。