让机器人操作面板更安全,能自动发现并修复违规步骤。
PanelShield: Verifiable Closed-Loop Safe Planning for Robotic Industrial Panel Operation

- 基于手册生成可验证的动作序列,结合逻辑与状态机双重校验
- 违规率降至2.7%,总延迟仅4.1秒,实测可端到端运行
- 适合工业场景中对安全与可审计性要求高的机器人操作
工业面板操作知识密集且安全关键。除控制识别与动作生成外,执行过程必须满足操作手册和安全规范中的约束。尽管基于基础模型的规划器具备强大的语义能力,但通常缺乏可计算、可定位、可复现的违规检测与修复机制。为此,我们提出PanelShield,一种面向人工引导工业面板操作的可验证闭环安全规划框架。该框架从任务相关的手册证据生成参数化动作基元序列,并采用线性时序逻辑(LTL)与安全有限状态机(Safety FSM)进行双重形式化验证,确保跨步时序正确性与局部转移合法性。当发生违规时,系统输出包含最早违规步骤及原因的结构化反例,支持针对性修复与重新验证。我们构建了一个涵盖三类典型工业设备面板的多层级长时程规划基准测试集,并在仿真与真实机器人实验中评估了该框架。结果表明,PanelShield在复杂安全约束任务上的表现优于仅依赖基础模型的规划基线,违规率降低至2.7%,总延迟为4.1秒。真实世界实验验证了其端到端可行性。总体而言,PanelShield提供了一种在灵活性、安全性与可审计性之间取得平衡的可验证机器人面板操作方案。
原文摘要 · Abstract (English)
Industrial panel operation is knowledge-intensive and safety-critical. Beyond control recognition and action generation, execution must satisfy constraints in operation manuals and safety regulations. While foundation-model-based planners show strong semantic capability, they typically lack computable, localizable, and reproducible mechanisms for violation detection and repair. To address this, we propose PanelShield, a verifiable closed-loop safety planning framework for manual-guided industrial panel operation. The framework generates parameterized action primitive sequences from task-relevant manual evidence and applies dual formal verification with LTL and a Safety FSM to enforce cross-step temporal correctness and local transition legality. When violations occur, it outputs a structured counterexample with the earliest violating step and cause, enabling targeted repair and re-verification. We build a multi-level long-horizon planning benchmark covering three representative industrial device panels, and evaluate the framework in simulation and real-world robotic experiments. Results show that PanelShield improves complex safety-constrained task performance over foundation-model-only planning baselines while reducing the violation rate to 2.7%, with 4.1 s total latency. Real-world experiments demonstrate end-toend feasibility. Overall, PanelShield offers a verifiable approach to robotic panel operation that balances flexibility, safety, and auditability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。