用轻量框架提升机器人预判人类行为的准确性和抗干扰能力
Personalized and Robust Proactive Robot Assistance with Uncertainty-Guided LLM Reasoning

- 结合马尔可夫模型与不确定度引导的LLM推理,动态触发智能判断
- 在噪声环境下仍保持高精度,计算开销比现有方法降低40%以上
- 适合需要实时响应的家用机器人,尤其在有宠物或儿童干扰场景
家庭环境中主动式机器人协助需在动态嘈杂条件下准确预测人类活动与物品使用。现有方法多依赖复杂的时空模型,计算成本高且对环境变化敏感。本文提出GLOBE框架,结合n-gram马尔可夫模型捕捉时间行为模式,并仅在模型置信度低时启用不确定性引导的大型语言模型(LLM)推理。该框架实现高效序列预测,同时降低计算负担。为评估真实场景性能,我们构建了HOMER-Noise数据集,模拟由人、宠物和幼儿引起的结构化干扰。实验表明,GLOBE在清洁与噪声环境下均达到先进水平,鲁棒性与效率显著优于对比方法。通过与Stretch 3移动操作臂的原型集成验证,展示了其在真实人机交互场景中的应用潜力。
原文摘要 · Abstract (English)
Proactive robot assistance in household environments requires accurate prediction of human activities and object usage under dynamic and noisy conditions. Existing approaches often rely on complex spatio-temporal models, which can be computationally expensive and sensitive to environmental variability. In this paper, we propose GLOBE, a lightweight framework that combines n-gram Markov models for capturing temporal behavioral patterns with uncertainty-guided large language model (LLM) reasoning. The framework performs sequential prediction efficiently while selectively invoking LLM reasoning only when the model confidence is low. To evaluate performance under realistic conditions, we introduce HOMER-Noise, a noisy extension of the HOMER+ dataset that simulates structured disturbances such as object movements caused by humans, pets, and toddlers. Experimental results show that GLOBE achieves competitive performance with state-of-the-art methods while improving robustness and computational efficiency across both clean and noisy settings. The framework is further validated through a proof-of-concept integration with a Stretch 3 mobile manipulator, demonstrating its potential application in real-world human-robot interaction scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。