arXiv:2502.17221cs.RO2025-02被引 3

用强化学习让机器人滑动操控物体,自适应不同摩擦表面。

A Reinforcement Learning Approach to Non-prehensile Manipulation through Sliding

  • 用DDPG算法控制机械臂加速度,实现物体滑动轨迹精确控制。
  • 实时估计摩擦力并反馈,使模型在不同表面表现稳定。
  • 训练后直接用于真实场景,无需重新训练,适合动态操作任务。

尽管机器人应用日益需要灵活多变的动态物体操作,但现有技术大多集中于抓取式操纵,限制了非抓握类任务的应用。为解决此问题,本文提出一种基于深度确定性策略梯度(DDPG)的强化学习框架,用于高效执行物体在平面上的滑动操纵。该算法通过精确控制与水平面刚性连接的机械臂加速度,生成线性轨迹,实现物体相对滑动。此外,开发了两种算法以在滑动过程中动态估算摩擦力,每次动作后提供在线摩擦估计,并作为关键反馈输入至策略模型。这一反馈机制提升了策略的适应性与鲁棒性,确保平台加速度能根据表面条件变化精准调整。所提方法在仿真与真实实验中均得到验证,结果表明该框架不仅能有效泛化至不同距离的滑动任务,更关键的是可适应多种摩擦特性不同的表面。值得注意的是,训练好的模型展现出零样本模拟到现实的迁移能力。

原文摘要 · Abstract (English)

Although robotic applications increasingly demand versatile and dynamic object handling, most existing techniques are predominantly focused on grasp-based manipulation, limiting their applicability in non-prehensile tasks. To address this need, this study introduces a Deep Deterministic Policy Gradient (DDPG) reinforcement learning framework for efficient non-prehensile manipulation, specifically for sliding an object on a surface. The algorithm generates a linear trajectory by precisely controlling the acceleration of a robotic arm rigidly coupled to the horizontal surface, enabling the relative manipulation of an object as it slides on top of the surface. Furthermore, two distinct algorithms have been developed to estimate the frictional forces dynamically during the sliding process. These algorithms provide online friction estimates after each action, which are fed back into the actor model as critical feedback after each action. This feedback mechanism enhances the policy's adaptability and robustness, ensuring more precise control of the platform's acceleration in response to varying surface condition. The proposed algorithm is validated through simulations and real-world experiments. Results demonstrate that the proposed framework effectively generalizes sliding manipulation across varying distances and, more importantly, adapts to different surfaces with diverse frictional properties. Notably, the trained model exhibits zero-shot sim-to-real transfer capabilities.

强化学习滑动操控摩擦估计机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。