arXiv:2409.11935cs.ROcs.LG2024-09ICRA被引 2

用李群结构改进机器人方向表示,提升强化学习性能

Reinforcement Learning with Lie Group Orientations for Robotics

  • 在神经网络输入输出中引入李群结构处理方向数据
  • 在多种任务中表现优于常见方向表示方法
  • 适合机器人控制与强化学习研究者使用

机器人与物体的方向处理是众多应用中的关键问题。然而,在涉及人工神经网络的学习流程中,方向处理常缺乏数学严谨性。本文研究了基于方向的强化学习,提出一种简单的网络输入输出修改方案,使其符合方向的李群结构。该方法实现简单高效,可直接集成至现有学习框架,显著优于其他常见方向表示方式。文章简要介绍了机器人方向相关的李理论以支撑方法设计,并通过大量实验评估不同状态与动作方向表示组合的表现,证明所提方法在直接方向控制、末端执行器方向控制及抓取放置任务中均具优越性。

原文摘要 · Abstract (English)

Handling orientations of robots and objects is a crucial aspect of many applications. Yet, ever so often, there is a lack of mathematical correctness when dealing with orientations, especially in learning pipelines involving, for example, artificial neural networks. In this paper, we investigate reinforcement learning with orientations and propose a simple modification of the network's input and output that adheres to the Lie group structure of orientations. As a result, we obtain an easy and efficient implementation that is directly usable with existing learning libraries and achieves significantly better performance than other common orientation representations. We briefly introduce Lie theory specifically for orientations in robotics to motivate and outline our approach. Subsequently, a thorough empirical evaluation of different combinations of orientation representations for states and actions demonstrates the superior performance of our proposed approach in different scenarios, including: direct orientation control, end effector orientation control, and pick-and-place tasks.

强化学习机器人控制李群

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。