让真人实时与虚拟机器人互动,提升人机协同智能化水平。
SymBridge: A Human-in-the-Loop Cyber-Physical Interactive System for Adaptive Human-Robot Symbiosis
- 用增强现实技术实现真人与虚拟机器人的物理环境交互。
- 通过持续观察人类行为,实时生成精准适应的机器人动作。
- 支持人类反馈收集与模型动态优化,适合人机交互研究者使用。
智能机器人的发展旨在无缝融入人类世界,提供日常生活与工作中的辅助与陪伴,最终实现人机共生。这要求机器人具备自然有效的智能交互能力。然而,现有机器人模拟器无法支持真实人类参与,限制了真实交互体验的获取和关键的人类反馈积累。本文提出SymBridge,首个支持真人参与的网络-物理交互系统,用于安全高效地开发、评估与优化人机交互方法。我们利用增强现实技术,使真实用户可在物理环境中与虚拟机器人互动,构建真实交互体验。在此基础上,提出一种新型机器人交互模型,通过持续观测人类行为,实时生成响应性强、精度高的机器人动作;该模型融合多分辨率人体运动特征与环境可及性信息,确保上下文自适应的响应。此外,SymBridge通过收集人类反馈实现机器人持续学习,并动态调整交互模型。借助精心设计的系统架构与模块,该系统在虚拟与物理空间之间搭建桥梁,提供自然真实的在线交互体验,推动机器人智能的持续进化。大量实验、用户研究与真实机器人测试验证了系统的卓越性能,展现了其在人机共生研究中的巨大潜力。
原文摘要 · Abstract (English)
The development of intelligent robots seeks to seamlessly integrate them into the human world, providing assistance and companionship in daily life and work, with the ultimate goal of achieving human-robot symbiosis. This requires robots with intelligent interaction abilities to work naturally and effectively with humans. However, current robotic simulators fail to support real human participation, limiting their ability to provide authentic interaction experiences and gather valuable human feedback essential for enhancing robotic capabilities. In this paper, we introduce SymBridge, the first human-in-the-loop cyber-physical interactive system designed to enable the safe and efficient development, evaluation, and optimization of human-robot interaction methods. Specifically, we employ augmented reality technology to enable real humans to interact with virtual robots in physical environments, creating an authentic interactive experience. Building on this, we propose a novel robotic interaction model that generates responsive, precise robot actions in real time through continuous human behavior observation. The model incorporates multi-resolution human motion features and environmental affordances, ensuring contextually adaptive robotic responses. Additionally, SymBridge enables continuous robot learning by collecting human feedback and dynamically adapting the robotic interaction model. By leveraging a carefully designed system architecture and modules, SymBridge builds a bridge between humans and robots, as well as between cyber and physical spaces, providing a natural and realistic online interaction experience while facilitating the continuous evolution of robotic intelligence. Extensive experiments, user studies, and real robot testing demonstrate the promising performance of the system and highlight its potential to significantly advance research on human-robot symbiosis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。