用机器人主动采集数据,精准调校无法直接观测的仿真模型参数。
ASBI: Leveraging Informative Real-World Data for Active Black-Box Simulator Tuning
- 通过最大化信息增益,智能规划机器人动作以收集关键数据。
- 三组仿真验证后验分布高度集中于真实参数值,误差极小。
- 适合需要高精度仿真调参的机器人研发与实际应用。
黑箱仿真器在机器人领域广泛应用,但因无法访问似然函数,参数优化困难。模拟推断(SBI)通过离线真实观测与正向仿真估计后验分布,但在黑箱场景下,获取能有效支撑参数估计的真实观测极为困难,因参数与观测间关系未知。本文提出主动模拟推断(ASBI),一种利用机器人主动采集在线真实数据来实现高精度黑箱仿真器调参的框架。该框架通过最大化信息增益(即后验与先验间香农熵的期望减少量)优化机器人动作,以获取最相关信息。尽管信息增益计算需似然函数,而黑箱环境中不可得,本文通过神经后验估计(NPE)方法,利用神经网络学习后验估计器来解决此问题。三个仿真实验定量验证了本方法可实现精确参数估计,后验分布显著集中于真实参数附近。此外,我们在真实机器人上应用该方法,通过倾倒桶中颗粒的动作,成功估算了对应于珠子和碎石的立方体粒子仿真参数。
原文摘要 · Abstract (English)
Black-box simulators are widely used in robotics, but optimizing their parameters remains challenging due to inaccessible likelihoods. Simulation-Based Inference (SBI) tackles this issue using simulation-driven approaches, estimating the posterior from offline real observations and forward simulations. However, in black-box scenarios, preparing observations that contain sufficient information for parameter estimation is difficult due to the unknown relationship between parameters and observations. In this work, we present Active Simulation-Based Inference (ASBI), a parameter estimation framework that uses robots to actively collect real-world online data to achieve accurate black-box simulator tuning. Our framework optimizes robot actions to collect informative observations by maximizing information gain, which is defined as the expected reduction in Shannon entropy between the posterior and the prior. While calculating information gain requires the likelihood, which is inaccessible in black-box simulators, our method solves this problem by leveraging Neural Posterior Estimation (NPE), which leverages a neural network to learn the posterior estimator. Three simulation experiments quantitatively verify that our method achieves accurate parameter estimation, with posteriors sharply concentrated around the true parameters. Moreover, we show a practical application using a real robot to estimate the simulation parameters of cubic particles corresponding to two real objects, beads and gravel, with a bucket pouring action.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。