QBIT框架通过多维度指标评估机器人插入任务质量,提升从仿真到现实的可靠性。
QBIT: Quality-Aware Cloud-Based Benchmarking for Robotic Insertion Tasks
- 引入力能、力平滑度等新指标,全面评估插入质量
- 在大规模仿真中验证三种方法,学习法表现最优
- 支持云端部署与物理机器人无缝衔接,适合工业落地
插入任务是机器人自主操作中的基础且具挑战性任务,因其与环境持续交互。尽管基于AI的方法展现出潜力,但在实际应用中不仅需高成功率,还需保证插入质量与可靠性。为此,我们提出QBIT——一种质量感知的云基基准测试框架,引入力能、力平滑度和完成时间等额外指标,实现全面评估。为确保统计显著性并缩小仿真到现实的差距,我们在MuJoCo模拟器中随机化接触参数,考虑感知不确定性,并基于Kubernetes基础设施开展大规模实验。微服务架构保障了可扩展性、普适性与可复现性。为促进向物理机器人测试的无缝过渡,采用ROS2与容器化技术降低集成门槛。我们使用三种插入方法(几何法、力控法、学习法)在仿真与真实环境中评估QBIT。仿真中对比了不同网格分解技术对接触模拟精度的影响。结果表明,QBIT能有效比较不同方法,并加速实验室成果向现实应用转化。代码已开源。
原文摘要 · Abstract (English)
Insertion tasks are fundamental yet challenging for robots, particularly in autonomous operations, due to their continuous interaction with the environment. AI-based approaches appear to be up to the challenge, but in production they must not only achieve high success rates. They must also ensure insertion quality and reliability. To address this, we introduce QBIT, a quality-aware benchmarking framework that incorporates additional metrics such as force energy, force smoothness and completion time to provide a comprehensive assessment. To ensure statistical significance and minimize the sim-to-real gap, we randomize contact parameters in the MuJoCo simulator, account for perceptual uncertainty, and conduct large-scale experiments on a Kubernetes-based infrastructure. Our microservice-oriented architecture ensures extensibility, broad applicability, and improved reproducibility. To facilitate seamless transitions to physical robotic testing, we use ROS2 with containerization to reduce integration barriers. We evaluate QBIT using three insertion approaches: geometricbased, force-based, and learning-based, in both simulated and real-world environments. In simulation, we compare the accuracy of contact simulation using different mesh decomposition techniques. Our results demonstrate the effectiveness of QBIT in comparing different insertion approaches and accelerating the transition from laboratory to real-world applications. Code is available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。