arXiv:2606.09416cs.ROcs.AI2026-06被引 3

机器人中间件应作为物理AI的控制枢纽,统一管理调度、资源与通信。

Harness Engineering for Physical AI: Robot Middleware Is the Harness Layer

论文配图:Harness Engineering for Physical AI: Robot Middleware Is the Harness Layer
图 1 · 摘自论文原文
  • 将机器人中间件定义为物理AI的'控制枢纽',协调控制、计算与通信三者
  • 提出投影、隔离、迁移三类强制机制,确保AI模型安全执行
  • 适用于需可靠部署学习型机器人的研发团队与系统集成者

在物理AI时代,机器人中间件面临新角色。学习型策略、规划器与视觉-语言-动作(VLA)模型作为因果参与者进入机器人控制系统,但整合它们的时间、调度与网络的层级尚未命名。近期语言代理研究将此层称为‘枢纽’(harness),即中介工具、管理状态、限制资源并记录执行的外部系统。机器人社区尚未采纳此框架,本文提出:机器人中间件即是该枢纽。物理AI枢纽与软件枢纽的区别在于介入位置:软件枢纽在工具调用边界介入,而物理AI枢纽必须同时在控制、计算与通信层面介入,因学习策略的输出同时影响轨迹、推理时延与数据带宽。机器人中间件是唯一具备对三者抽象控制的底层栈,最适合作为三者约束的组合层。它已具备大部分枢纽所需功能,但缺少对AI模型的强制执行能力。本文提出三种缺失功能:投影门在输出发出时进行截断,隔离限制模型的执行与传输时段,迁移在检测失败时回退至经验证基线。这些功能当前以手写代码形式存在于部署系统中,基于中间件已提供的接口。建议将这三者置于中间件层,而非单一维度强化,以实现全栈协同。本文以ROS 2 Harness Profile为例,描述一种部署构件,携带模型声明的输出范围、推理预算与运行模式,由中间件跨ROS 2、DDS与Zenoh实施强制执行。

原文摘要 · Abstract (English)

Robot middleware faces a new role in the era of Physical AI. Learned policies, planners, and vision-language-action (VLA) models now enter deployed robots as causal participants on the control path, but the layer that integrates them with timing, scheduling, and network has not been named. Recent language-agent work names this layer the harness, the external system that mediates tools, manages state, bounds resources, and records execution. The robotics community has not yet adopted this framing, and we propose that robot middleware is that harness. A Physical AI harness differs from a software harness in where it intervenes. A software harness mediates at tool-call boundaries. A Physical AI harness must mediate at control, computing, and communication simultaneously, because a learned policy's output crosses all three: its commands shift the trajectory, its inference time shifts the schedule, and its payload shifts the bandwidth. Robot middleware is the lowest robot-stack layer with mediating abstractions over all three, so it is best positioned to compose their enforcement. It already provides most of what a harness needs but lacks the enforcement for an AI model. We name this missing enforcement as three functions: Projection gates each output at emission, Isolation bounds the model's execution and transmission slot, and Transfer falls back to a verified baseline when checks fail. Each appears today as hand-built application code in deployed robot systems, built on surfaces robot middleware already provides. Robot middleware should host them not as the best single-axis enforcer but as the layer that composes all three. We sketch this as a ROS 2 Harness Profile, a deployment artifact that carries an AI model's declared output region, inference budget, and operating regime while the middleware enforces them across ROS 2, DDS, and Zenoh.

机器人中间件物理AI系统架构ROS 2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。