为头戴AR用户优化的多智能体定位系统,降低延迟提升体验。
SHARE: Towards Head-Mounted AR with User-Centric SLAM in Shared Human-Robot Workspaces

- 根据用户需求动态调整传输优先级,构建人机协作体验模型。
- 实测AR用户平均延迟降至13.22毫秒,较基线降低43.3%。
- 适合需低延迟交互的协同机器人与头戴AR场景。
在共享物理空间中,人机协作(HRC)通过增强现实(AR)界面实现,其核心依赖于同时定位与地图构建(SLAM)。现有多智能体SLAM系统依赖边缘服务器整合多个资源受限智能体的视觉信息,进行计算并调度本地地图更新。然而,该机制对所有智能体一视同仁,忽略了异构HRC智能体(如机器人与头戴式AR用户)不同的延迟需求。这种统一资源分配常导致用户操作延迟过高,无法满足AR的严苛时延要求。本文设计并实现了一种面向用户的新型SLAM系统SHARE,通过策略性优先保障AR用户体验,同时维持机器人的高精度跟踪性能。SHARE首次构建了针对人机协作智能体的体验模型,并自适应调整数据传输优先级。为降低端到端延迟,系统利用共享工作空间中多个智能体视觉特征的冗余性,减少边缘计算带来的处理时间。在商用AR头显与地面机器人的真实部署中,实现了AR用户13.22毫秒的平均延迟(相较基线降低43.3%),同时保持亚2厘米的跟踪精度。用户实验进一步证实感知体验有统计学显著提升。
原文摘要 · Abstract (English)
Human-Robot Collaboration (HRC) in shared physical spaces using Augmented Reality (AR) interfaces is powered by Simultaneous Localization and Mapping (SLAM). Existing multi-agent SLAM systems rely on an edge server to combine visual findings of multiple resource-constrained agents, perform computation, and schedule updates to their local maps. However, the edge treats all agents uniformly and ignores the fundamentally different latency requirements of heterogeneous HRC agents: robots and head-mounted AR users. This uniform resource allocation often results in high lag for user manipulation, as it does not meet the stringent latency requirements of AR. In this work, we design, implement, and evaluate SHARE, a user-centric SLAM system that strategically prioritizes AR user experience while maintaining accurate tracking performance for robots. SHARE builds a first-of-its-kind experience model for HRC agents and adaptively adjusts transmission priorities to match it. To reduce end-to-end latency, SHARE leverages the redundancy of visual features acquired by agents in shared human-robot workspaces to reduce computation time induced by edge-based processing. Real-world deployment with commercial AR headsets and a ground robot achieves 13.22 ms average latency for AR users (43.3% reduction from baseline) while maintaining sub-2-centimeter tracking accuracy. User studies further reveal statistically significant improvements in user perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。