用语言反馈实时更新机器人安全规则,让机器人边工作边学习新安全要求。
Updating Robot Safety Representations Online from Natural Language Feedback
- 通过视觉语言模型解析语言指令和图像,动态构建安全约束
- 在线更新哈密顿-雅可比可达性控制器,保持实时安全性
- 适合家庭等复杂环境中需要持续适应的人机协作场景
机器人在家庭等新型人机共存环境中部署时必须保证安全。现有安全控制方法通常假设安全约束事先已知,因此可预先计算安全控制器。然而,部分约束(如液体洒漏、易碎物品)具有高度主观性、情境依赖性,只能在部署阶段通过与特定环境和人员互动时识别。此时,语言成为灵活传递这些动态安全约束的有效方式。本文利用视觉语言模型(VLMs)理解语言反馈与机器人感知的图像,持续更新其对安全约束的表征,并通过高效的热启动技术在线调整哈密顿-雅可比可达性安全控制器。仿真与硬件实验表明,该方法使机器人能够有效推断并遵守基于语言的安全约束。
原文摘要 · Abstract (English)
Robots must operate safely when deployed in novel and human-centered environments, like homes. Current safe control approaches typically assume that the safety constraints are known a priori, and thus, the robot can pre-compute a corresponding safety controller. While this may make sense for some safety constraints (e.g., avoiding collision with walls by analyzing a floor plan), other constraints are more complex (e.g., spills), inherently personal, context-dependent, and can only be identified at deployment time when the robot is interacting in a specific environment and with a specific person (e.g., fragile objects, expensive rugs). Here, language provides a flexible mechanism to communicate these evolving safety constraints to the robot. In this work, we use vision language models (VLMs) to interpret language feedback and the robot's image observations to continuously update the robot's representation of safety constraints. With these inferred constraints, we update a Hamilton-Jacobi reachability safety controller online via efficient warm-starting techniques. Through simulation and hardware experiments, we demonstrate the robot's ability to infer and respect language-based safety constraints with the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。