让机器人安全控制可验证,分离大模型感知与小模块安全决策。
Verifiable Foundation Models for Robot Safety

- 大模型负责感知推理,小模块专注安全判断,实现分工协同。
- 安全模块经形式化验证,可确保碰撞避免等关键约束不被突破。
- 适用于需高安全性的机器人任务,尤其适合想落地的科研团队。
将基础模型用于机器人控制面临核心挑战:其强大的多模态感知能力使模型变得不透明,难以进行形式化分析,导致现有验证工具失效。本文提出FEARL(Foundation-Enabled Assured Robot Learning)框架,通过模块化架构分解解决该矛盾。FEARL将策略分为大型控制器(C)和小型安全模块(S):C负责高维感知与任务推理,S接收来自专用安全传感器的低维观测及来自C的有限上下文嵌入,输出最终动作。由于许多机器人安全需求(如避障、工作空间边界约束)可基于安全传感器观测表达,因此可对S而非完整基础模型进行形式化验证,使分析在现有工具下可行,同时保留控制器的任务推理能力。为验证分解策略的有效性,我们在三个模拟机器人场景中使用多种控制器骨干网络和训练方法评估FEARL,包括预训练的视觉-语言-动作模型。此外,我们将其中一个任务的训练策略成功迁移至物理机器人,表明低维安全接口支持有效的模拟到现实迁移。
原文摘要 · Abstract (English)
Deploying foundation models for robot control raises a central challenge: the expressive power that enables rich, multimodal perception also makes these models opaque and difficult to analyze formally, rendering them intractable for existing verification tools. In this paper, we present FEARL (Foundation-Enabled Assured Robot Learning), a framework that addresses this tension through a modular architectural decomposition. FEARL separates the policy into a large Controller (C) responsible for high-dimensional perception and task reasoning, and a small Safety module (S) that receives low-dimensional observations from dedicated safety sensors together with a bounded context embedding from C and produces the final action. Since many robot safety requirements, such as collision avoidance and workspace boundary constraints, can be expressed over these safety sensor observations, formal verification can be applied to S rather than to the full foundation-model backbone. This makes formal analysis tractable with existing tools while preserving the Controller's expressive power for task reasoning. To show that the decomposed policy remains capable of solving diverse tasks, we evaluate FEARL on three simulated robotic domains using multiple Controller backbones and training procedures, including pretrained off-the-shelf vision-language-action models. We further transfer the learned policy from one of our simulated tasks to a physical robot, suggesting that the low-dimensional safety interface supports practical sim-to-real transfer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。