用可执行逻辑防护机器人,实时识别并预防危险动作。
RoboSafe: Safeguarding Embodied Agents via Executable Safety Logic
- 通过长短时安全记忆融合反向反思与前向预测推理
- 减少36.8%的危险行为发生,任务性能几乎不受影响
- 适合需高安全性的机器人实操场景,如医疗、工业
由视觉语言模型驱动的具身智能体在执行复杂现实任务方面能力日益增强,但仍易受危险指令影响而产生不安全行为。运行时安全防护机制因灵活性高而成为有效解决方案,但现有方法多依赖静态规则过滤或提示层控制,在动态、时序依赖和上下文丰富的环境中难以应对隐性风险。为此,我们提出RoboSafe,一种基于可执行谓词的安全逻辑混合推理框架。该框架在混合长短期安全记忆上集成两种互补推理过程:首先设计反向反思模块,持续回溯短期记忆中的近期轨迹,推断时间安全性谓词,并在检测到违规时主动触发重规划;其次设计前向预测模块,结合长期安全记忆与多模态观测生成情境感知的安全性谓词以预判潜在风险。二者协同形成可解释、可执行的自适应安全逻辑。大量实验表明,相较于领先基线,RoboSafe显著降低危险行为发生率(-36.8%),同时保持接近原始的任务性能。物理机器人手臂的实地测试进一步验证了其实际可行性。代码将在论文录用后公开。
原文摘要 · Abstract (English)
Embodied agents powered by vision-language models (VLMs) are increasingly capable of executing complex real-world tasks, yet they remain vulnerable to hazardous instructions that may trigger unsafe behaviors. Runtime safety guardrails, which intercept hazardous actions during task execution, offer a promising solution due to their flexibility. However, existing defenses often rely on static rule filters or prompt-level control, which struggle to address implicit risks arising in dynamic, temporally dependent, and context-rich environments. To address this, we propose RoboSafe, a hybrid reasoning runtime safeguard for embodied agents through executable predicate-based safety logic. RoboSafe integrates two complementary reasoning processes on a Hybrid Long-Short Safety Memory. We first propose a Backward Reflective Reasoning module that continuously revisits recent trajectories in short-term memory to infer temporal safety predicates and proactively triggers replanning when violations are detected. We then propose a Forward Predictive Reasoning module that anticipates upcoming risks by generating context-aware safety predicates from the long-term safety memory and the agent's multimodal observations. Together, these components form an adaptive, verifiable safety logic that is both interpretable and executable as code. Extensive experiments across multiple agents demonstrate that RoboSafe substantially reduces hazardous actions (-36.8% risk occurrence) compared with leading baselines, while maintaining near-original task performance. Real-world evaluations on physical robotic arms further confirm its practicality. Code will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。