用压缩动作块嵌入提升灵巧机械手操作效率
VQ-ACE: Efficient Policy Search for Dexterous Robotic Manipulation via Action Chunking Embedding
- 将人类手部动作压缩到量化潜在空间,降低动作维度
- 结合MPC与RL,任务成功率提升且控制成本下降
- 适合需要高维动作的灵巧操作场景,如抓取与翻转
灵巧机器人操作因手部运动高维复杂而面临挑战,尤其在物体翻转和抓取等任务中。本文提出向量量化动作块嵌入(VQ-ACE),将人类手部动作压缩至量化潜在空间,显著降低动作空间维度,同时保留关键运动特征。通过结合模型预测控制(MPC)与强化学习(RL),在仿生机械手上实现了更高效的探索与策略学习。实验表明,基于潜在空间采样的MPC在球体滚动与物体拾取任务中生成更类人的行为,提升任务成功率并降低控制成本;对于RL,动作分块加速学习过程,实现立方体堆叠与物体翻转任务中的快速收敛。结果表明,VQ-ACE为复杂高维状态空间下的机器人操作提供了可扩展且高效解决方案,推动更自然、自适应的机器人系统发展。
原文摘要 · Abstract (English)
Dexterous robotic manipulation remains a significant challenge due to the high dimensionality and complexity of hand movements required for tasks like in-hand manipulation and object grasping. This paper addresses this issue by introducing Vector Quantized Action Chunking Embedding (VQ-ACE), a novel framework that compresses human hand motion into a quantized latent space, significantly reducing the action space's dimensionality while preserving key motion characteristics. By integrating VQ-ACE with both Model Predictive Control (MPC) and Reinforcement Learning (RL), we enable more efficient exploration and policy learning in dexterous manipulation tasks using a biomimetic robotic hand. Our results show that latent space sampling with MPC produces more human-like behavior in tasks such as Ball Rolling and Object Picking, leading to higher task success rates and reduced control costs. For RL, action chunking accelerates learning and improves exploration, demonstrated through faster convergence in tasks like cube stacking and in-hand cube reorientation. These findings suggest that VQ-ACE offers a scalable and effective solution for robotic manipulation tasks involving complex, high-dimensional state spaces, contributing to more natural and adaptable robotic systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。