arXiv:2604.11174cs.ROcs.AI2026-04被引 1

评测机器人系统在真实扰动下的可控性与安全恢复能力。

EmbodiedGovBench: A Benchmark for Governance, Recovery, and Upgrade Safety in Embodied Agent Systems

  • 构建七维治理评估框架,覆盖政策约束与系统可回滚性
  • 在单机与多机场景下验证系统在扰动下的恢复成功率
  • 适合关注机器人安全演进与人类干预的开发者与研究者

具身智能近年发展迅速,催生了大量机器人策略、基础模型与模块化运行时。然而现有评估仍以任务完成率或操作精度等指标为主,忽视了系统是否具备可治理性——即是否遵守能力边界、执行政策、安全恢复、保留审计日志并响应人类干预。本文提出EmbodiedGovBench,一个面向治理能力的具身智能系统评估基准。该基准不仅考察机器人能否完成任务,更评估其在现实扰动下是否保持可控、政策受限、可恢复、可审计及演进安全。涵盖七项治理维度:未经授权的能力调用、运行时漂移鲁棒性、恢复成功率、政策可移植性、版本升级安全性、人工干预响应性与审计完整性。基准包含单机与集群设置、场景模板、扰动算子、治理指标与基线评估协议,并支持模块化接口与契约感知的升级流程。分析表明,具身治理应成为首要评估目标。EmbodiedGovBench为此转变提供了首个量化框架。

原文摘要 · Abstract (English)

Recent progress in embodied AI has produced a growing ecosystem of robot policies, foundation models, and modular runtimes. However, current evaluation remains dominated by task success metrics such as completion rate or manipulation accuracy. These metrics leave a critical gap: they do not measure whether embodied systems are governable -- whether they respect capability boundaries, enforce policies, recover safely, maintain audit trails, and respond to human oversight. We present EmbodiedGovBench, a benchmark for governance-oriented evaluation of embodied agent systems. Rather than asking only whether a robot can complete a task, EmbodiedGovBench evaluates whether the system remains controllable, policy-bounded, recoverable, auditable, and evolution-safe under realistic perturbations. The benchmark covers seven governance dimensions: unauthorized capability invocation, runtime drift robustness, recovery success, policy portability, version upgrade safety, human override responsiveness, and audit completeness. We define a benchmark structure spanning single-robot and fleet settings, with scenario templates, perturbation operators, governance metrics, and baseline evaluation protocols. We describe how the benchmark can be instantiated over embodied capability runtimes with modular interfaces and contract-aware upgrade workflows. Our analysis suggests that embodied governance should become a first-class evaluation target. EmbodiedGovBench provides the initial measurement framework for that shift.

具身智能治理评估安全恢复机器人系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。