两足机器人协作搬运时,靠本地感知实现避障,无需地图或预规划路径。
Learning Multi-Agent Local Collision-Avoidance for Collaborative Carrying tasks with Coupled Quadrupedal Robots
- 用分层强化学习框架,高阶策略指挥两个预训练步态策略。
- 在未知环境中成功避障,硬件实验验证系统可在无地图条件下运行。
- 采用游戏式渐进训练,提升复杂障碍物适应能力,适合多机器人协同任务。
机器人协同搬运可显著提升仓库和建筑工地等场景的效率。然而,协调多个机器人同时运动仍是重大挑战。现有方法多聚焦于无障碍环境,难以适用于真实场景;而考虑障碍物的方法要么对特定地形过拟合,要么依赖预录地图与路径规划器生成无碰撞轨迹。本文研究两个通过球形关节机械连接的四足机器人协同搬运一个物体的任务。提出一种基于强化学习的策略,仅使用机载传感器实现对指令速度方向的跟踪,并避免与附近障碍物碰撞,无需预计算轨迹或完整地图信息。采用分层架构:感知型高层对象中心策略调用两个预训练的步态策略。此外,引入游戏化课程机制,逐步增加地形中障碍物的复杂度。在通过球形关节连接的两台四足机器人携带横杆的硬件平台上进行验证,对比了基于优化和去中心化强化学习的基线方法。实验表明,系统能在未知环境中自主移动,无需地图或路径规划器。视频材料见多媒体部分。
原文摘要 · Abstract (English)
Robotic collaborative carrying could greatly benefit human activities like warehouse and construction site management. However, coordinating the simultaneous motion of multiple robots represents a significant challenge. Existing works primarily focus on obstacle-free environments, making them unsuitable for most real-world applications. Works that account for obstacles, either overfit to a specific terrain configuration or rely on pre-recorded maps combined with path planners to compute collision-free trajectories. This work focuses on two quadrupedal robots mechanically connected to a carried object. We propose a Reinforcement Learning (RL)-based policy that enables tracking a commanded velocity direction while avoiding collisions with nearby obstacles using only onboard sensing, eliminating the need for precomputed trajectories and complete map knowledge. Our work presents a hierarchical architecture, where a perceptive high-level object-centric policy commands two pretrained locomotion policies. Additionally, we employ a game-inspired curriculum to increase the complexity of obstacles in the terrain progressively. We validate our approach on two quadrupedal robots connected to a bar via spherical joints, benchmarking it against optimization-based and decentralized RL baselines. Our hardware experiments demonstrate the ability of our system to locomote in unknown environments without the need for a map or a path planner. The video of our work is available in the multimedia material.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。