让智能体在真实世界中自主进化,打通认知与执行的隔阂。
PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution

- 以会话为中心调度,分离认知规划与物理执行,状态用文件形式共享。
- 通过证据验证任务完成,实现无需重训的试错闭环,知识可复用。
- 支持仿真到实物多形态部署,适合研发机器人系统的研究者使用。
视觉-语言-动作模型、世界模型和代理规划器各自推动物理智能发展,但它们的集成缺乏统一执行抽象、共享状态、语义验证和跨异构体的持续经验。我们提出PhyAgentOS,一个运行时基础架构,提供调度、验证、记忆、基准测试和安全等系统级服务。其会话中心运行时将会话而非单个动作作为最小调度单元,实现兼容性预检、监督执行、证据收集与接受。为解耦认知与物理执行,认知-物理边界采用文件系统:状态即文件协议将跨层状态以Markdown加YAML形式实体化,生成可检查、可版本化的记录,且不依赖代码耦合。这些视图构成统一的认知状态空间,对齐意图、能力、环境、执行与经验。会话验证器通过证据驱动的裁决区分执行终止与语义任务完成,判定成功、失败或重规划。已验证结果通过认知记忆整合为可复用的知识与修正教训,实现无重训练的试错循环。基准测试复用部署会话与验证路径,确保结果可追溯至真实执行。分层安全机制约束策略驱动与代理驱动的执行:预检、动作桥接、SafetyGuard、心跳监控与目标本地约束。验证过程逐步推进:游戏测试认知规划,仿真引入动力学与控制,真实机器人加入硬件噪声,认知层保持不变。PhyAgentOS在Optimus-67、StarDojo和DST-Dojo上验证,覆盖19+种仿真与物理形态,在LIBERO、Calvin和RoboCasa365上提升多个VLA模型性能。
原文摘要 · Abstract (English)
Vision-language-action models, world models, and agentic planners each advance physical intelligence, yet their composition lacks a common execution abstraction, shared state, semantic verification, and persistent experience across heterogeneous embodiments. We present PhyAgentOS, a runtime foundation delivering scheduling, verification, memory, benchmarking, and safety as system-level services. Its Session-Centered Runtime treats a session, not an action, as the minimum unit of scheduling, compatibility preflight, supervised execution, evidence collection, and acceptance. To decouple cognition from physical execution, the cognition-physics boundary is a file system: the State-as-a-File protocol materializes cross-layer state as Markdown with YAML, yielding inspectable, versionable records without code dependencies between Agent and Runtime layers. These views form a unified cognitive state space aligning intent, capabilities, environment, execution, and experience. The SessionVerifier distinguishes execution termination from semantic task completion via evidence-grounded verdicts of success, failure, or replan. Verified outcomes are consolidated through epistemic memory into reusable knowledge and corrective lessons, closing a trial-and-error loop without retraining. Benchmarking reuses the deployment session and verification path, so results trace to real execution. Layered safety constrains both policy-driven and agent-driven execution: preflight, action bridges, SafetyGuard, heartbeat monitoring, and target-local constraints. Validation is progressive: games test cognitive planning, simulation adds dynamics and control, real robots add hardware noise, with the cognitive layer held constant. PhyAgentOS is benchmarked on Optimus-67, StarDojo, and DST-Dojo, validated on 19+ simulated and physical embodiments, and gains on LIBERO, Calvin, and RoboCasa365 across multiple VLA models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。