arXiv:2607.16636cs.RO2026-07被引 2

让智能体在真实世界中自主进化,打通认知与执行的隔阂。

PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution

论文配图:PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution
图 1 · 摘自论文原文
  • 以会话为中心调度,分离认知规划与物理执行,状态用文件形式共享。
  • 通过证据验证任务完成,实现无需重训的试错闭环,知识可复用。
  • 支持仿真到实物多形态部署,适合研发机器人系统的研究者使用。

视觉-语言-动作模型、世界模型和代理规划器各自推动物理智能发展,但它们的集成缺乏统一执行抽象、共享状态、语义验证和跨异构体的持续经验。我们提出PhyAgentOS,一个运行时基础架构,提供调度、验证、记忆、基准测试和安全等系统级服务。其会话中心运行时将会话而非单个动作作为最小调度单元,实现兼容性预检、监督执行、证据收集与接受。为解耦认知与物理执行,认知-物理边界采用文件系统:状态即文件协议将跨层状态以Markdown加YAML形式实体化,生成可检查、可版本化的记录,且不依赖代码耦合。这些视图构成统一的认知状态空间,对齐意图、能力、环境、执行与经验。会话验证器通过证据驱动的裁决区分执行终止与语义任务完成,判定成功、失败或重规划。已验证结果通过认知记忆整合为可复用的知识与修正教训,实现无重训练的试错循环。基准测试复用部署会话与验证路径,确保结果可追溯至真实执行。分层安全机制约束策略驱动与代理驱动的执行:预检、动作桥接、SafetyGuard、心跳监控与目标本地约束。验证过程逐步推进:游戏测试认知规划,仿真引入动力学与控制,真实机器人加入硬件噪声,认知层保持不变。PhyAgentOS在Optimus-67、StarDojo和DST-Dojo上验证,覆盖19+种仿真与物理形态,在LIBERO、Calvin和RoboCasa365上提升多个VLA模型性能。

原文摘要 · Abstract (English)

Vision-language-action models, world models, and agentic planners each advance physical intelligence, yet their composition lacks a common execution abstraction, shared state, semantic verification, and persistent experience across heterogeneous embodiments. We present PhyAgentOS, a runtime foundation delivering scheduling, verification, memory, benchmarking, and safety as system-level services. Its Session-Centered Runtime treats a session, not an action, as the minimum unit of scheduling, compatibility preflight, supervised execution, evidence collection, and acceptance. To decouple cognition from physical execution, the cognition-physics boundary is a file system: the State-as-a-File protocol materializes cross-layer state as Markdown with YAML, yielding inspectable, versionable records without code dependencies between Agent and Runtime layers. These views form a unified cognitive state space aligning intent, capabilities, environment, execution, and experience. The SessionVerifier distinguishes execution termination from semantic task completion via evidence-grounded verdicts of success, failure, or replan. Verified outcomes are consolidated through epistemic memory into reusable knowledge and corrective lessons, closing a trial-and-error loop without retraining. Benchmarking reuses the deployment session and verification path, so results trace to real execution. Layered safety constrains both policy-driven and agent-driven execution: preflight, action bridges, SafetyGuard, heartbeat monitoring, and target-local constraints. Validation is progressive: games test cognitive planning, simulation adds dynamics and control, real robots add hardware noise, with the cognitive layer held constant. PhyAgentOS is benchmarked on Optimus-67, StarDojo, and DST-Dojo, validated on 19+ simulated and physical embodiments, and gains on LIBERO, Calvin, and RoboCasa365 across multiple VLA models.

机器人系统智能体自进化认知解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。