用任天堂游戏机玩跳舞机,测试机器人全身动作控制能力
Switch-JustDance: Benchmarking Whole Body Motion Tracking Controllers Using a Commercial Console Game
- 用游戏机舞蹈动作生成机器人可执行指令
- 在真实硬件上评估3个顶尖人形机器人控制器性能
- 提供可复现的真人-机器人对比评测方案
近年来,全身机器人控制技术的进步使人形和腿式机器人能够完成日益敏捷、协调的动作。然而,缺乏在真实场景中评估这些能力且能与人类直接对比的标准基准测试仍属普遍现象。现有评估多依赖预采集的人体动作数据集或基于仿真的实验,限制了可复现性,忽视了硬件因素,也阻碍了公平的人机比较。本文提出 Switch-JustDance,一个低成本、可复现的基准测试流程,利用 Nintendo Switch 上的舞蹈游戏 Just Dance 来评估机器人全身控制能力。通过将游戏中编排的动作流式传输、重建并重定向为机器人可执行的动作,Switch-JustDance 利用游戏内置评分系统实现控制器性能评估。我们首先验证了 Just Dance 的评估有效性,分析其可靠性、效度、敏感性及潜在偏差来源。结果表明该平台提供一致且可解释的性能指标,适合用于具身人工智能的基准测试。在此基础上,我们在真实硬件上对三个最先进的类人机器人全身控制器进行了基准测试,并揭示了它们各自的优劣势。
原文摘要 · Abstract (English)
Recent advances in whole-body robot control have enabled humanoid and legged robots to perform increasingly agile and coordinated motions. However, standardized benchmarks for evaluating these capabilities in real-world settings, and in direct comparison to humans, remain scarce. Existing evaluations often rely on pre-collected human motion datasets or simulation-based experiments, which limit reproducibility, overlook hardware factors, and hinder fair human-robot comparisons. We present Switch-JustDance, a low-cost and reproducible benchmarking pipeline that leverages motion-sensing console games, Just Dance on the Nintendo Switch, to evaluate robot whole-body control. Using Just Dance on the Nintendo Switch as a representative platform, Switch-JustDance converts in-game choreography into robot-executable motions through streaming, motion reconstruction, and motion retargeting modules and enables users to evaluate controller performance through the game's built-in scoring system. We first validate the evaluation properties of Just Dance, analyzing its reliability, validity, sensitivity, and potential sources of bias. Our results show that the platform provides consistent and interpretable performance measures, making it a suitable tool for benchmarking embodied AI. Building on this foundation, we benchmark three state-of-the-art humanoid whole-body controllers on hardware and provide insights into their relative strengths and limitations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。