arXiv:2507.06822cs.RO2025-07中稿 · 2025 IEEE/RSJ Inte…被引 4

用分层强化学习让机械手灵巧操作可变形态工具,实测抓取成功率70.8%。

Hierarchical Reinforcement Learning for Articulated Tool Manipulation with Multifingered Hand

  • 分层策略:底层控制手部变形,顶层规划抓取目标。
  • 在真实机器人上实现70.8%的抓取成功率,适配不同尺寸物体。
  • 引入点云编码器估计工具状态,提升操控精度。

以往研究极少关注可动工具(如镊子、剪刀)的操控问题。与刚性工具不同,可动工具会动态改变形状,对灵巧机械手带来独特挑战。本文提出一种分层、目标条件化的强化学习框架,提升拟人化机械手使用可动工具的操控能力。框架包含两层策略:(1) 底层策略使机械手将工具调整至适合不同尺寸物体的配置;(2) 高层策略定义工具的目标状态并控制机械臂完成抓取任务。我们采用在合成点云上训练的编码器,从输入点云中估计工具的可操作状态——即不同工具配置(如镊子开合角度)如何支持对不同尺寸物体的抓取,从而实现精准操控。此外,使用特权启发式策略生成回放缓冲区,显著提升高层策略的训练效率。通过真实世界实验验证,机器人能有效操控类似镊子的工具,成功抓取多种形状和尺寸的物体,整体成功率达70.8%。本研究展示了强化学习在推进灵巧机械手操控可动工具方面的潜力。

原文摘要 · Abstract (English)

Manipulating articulated tools, such as tweezers or scissors, has rarely been explored in previous research. Unlike rigid tools, articulated tools change their shape dynamically, creating unique challenges for dexterous robotic hands. In this work, we present a hierarchical, goal-conditioned reinforcement learning (GCRL) framework to improve the manipulation capabilities of anthropomorphic robotic hands using articulated tools. Our framework comprises two policy layers: (1) a low-level policy that enables the dexterous hand to manipulate the tool into various configurations for objects of different sizes, and (2) a high-level policy that defines the tool's goal state and controls the robotic arm for object-picking tasks. We employ an encoder, trained on synthetic pointclouds, to estimate the tool's affordance states--specifically, how different tool configurations (e.g., tweezer opening angles) enable grasping of objects of varying sizes--from input point clouds, thereby enabling precise tool manipulation. We also utilize a privilege-informed heuristic policy to generate replay buffer, improving the training efficiency of the high-level policy. We validate our approach through real-world experiments, showing that the robot can effectively manipulate a tweezer-like tool to grasp objects of diverse shapes and sizes with a 70.8 % success rate. This study highlights the potential of RL to advance dexterous robotic manipulation of articulated tools.

强化学习灵巧操作可动工具机械手

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。