用少量试错实现机器人动态抓取的精准目标调整
Prior Reinforce: Goal-Conditioned Dynamic Manipulation with Limited Trials
- 用条件扩散模型从少量演示中学习运动规律
- 仅需10次真实试验即可达成新目标,抗感知噪声
- 适合需要快速适应的现实场景机器人控制
具身机器人在许多现实操作任务中表现优异,但敏捷的动态操作仍因对运动参数敏感且结果反馈稀疏而困难。例如将篮球投入篮筐需精确控制高速开环运动,微小轨迹偏差可能导致结果大幅偏离,现有方法依赖大规模交互、奖励工程或精确动力学建模,难以高效适应。我们提出先验强化(Prior Reinforce, P.R.),一种面向目标条件的动态操作框架。该方法首先利用条件扩散模型从少量示范中学习结构化运动流形,随后在低维条件空间中通过反馈驱动优化实现向新目标的运动调整。通过分离运动生成与结果驱动的适应过程,该框架仅需少量真实世界试错即可高效优化,且对感知噪声和硬件不确定性具有鲁棒性。多个真实世界动态操作任务的实验表明,P.R. 在总计不超过十次试验下即可可靠达成新目标,展现出低试错成本的实用机器人适应能力。
原文摘要 · Abstract (English)
Embodied robots have achieved strong performance in many real-world manipulation tasks, yet agile dynamic manipulation remains challenging due to high sensitivity to motion parameters and sparse outcome-level feedback. Tasks such as shooting a basketball into a hoop require precise control of fast open-loop motions, where small trajectory variations can lead to large outcome deviations, making data-efficient adaptation difficult for existing methods that rely on large-scale interaction, reward engineering, or accurate dynamic modeling. We propose Prior Reinforce (P.R.), a simple and practical framework for goal-conditioned dynamic manipulation. The method first learns a structured motion manifold from a small set of demonstrations using a conditional diffusion model, and then adapts motions toward new goals through feedback-driven optimization in a low-dimensional condition space. By separating motion generation from outcome-driven adaptation, the framework enables efficient refinement using only a small number of real-world trials under noisy perception. Experiments on multiple real-world dynamic manipulation tasks demonstrate that P.R. reliably achieves new goals within as few as ten total trials while remaining robust to perception noise and hardware uncertainty, suggesting a practical approach for low-trial real-world robot adaptation. Project website: https://adap-robotics.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。