EWAM通过推理时协同推理机制,实现零样本下新任务布局的快速自适应。
EWAM: An Enhanced World Action Model for Closed-Loop Online Adaptation in Embodied Intelligence

- 在Cosmos3模型中插入四层轻量神经模块,实现推理时上下文记忆与异常检测。
- 无需额外演示数据或微调主干网络,仅用少量部署数据即可适配新任务。
- 适合需要快速响应真实场景变化的具身智能系统开发者使用。
本文提出增强型世界动作模型(EWAM),一种基于预训练且完全冻结的Cosmos3主干网络的闭环在线自适应架构。所有评估均在零样本任务协议下进行,核心目标是减少适配新任务布局所需的额外部署数据量。评估中未引入任何额外的任务特定示范数据集,也未对主干网络进行微调。性能提升完全来自推理时的协同推理机制,该机制包含四个插入的轻量神经层:位于Diffusion Transformer中间层的神经经验记忆层提供任务相关的执行上下文;状态预测头后的神经异常检测层实时监控预测状态与实际状态之间的偏差;神经策略路由层根据异常严重程度动态选择直接执行、保守重规划或回滚恢复;神经动作修正层利用执行诊断信息优化生成的动作块。与简单特征融合不同,记忆、异常检测和修正模块以可微方式深度集成于Cosmos3前向路径中,仅最终路由决策为离散监督决策。
原文摘要 · Abstract (English)
In this paper, we propose the Enhanced World Action Model (EWAM), a closed-loop online adaptation architecture built upon a pretrained and fully frozen Cosmos3 backbone network. Evaluated entirely under a zero-shot task protocol, EWAM is centrally focused on reducing the amount of additional deployment data required to adapt to new task layouts. Notably, no extra task-specific demonstration sets were introduced in any of the evaluations, and no fine-tuning was performed on the backbone network. Its performance gains stem entirely from an inference-time co-reasoning mechanism composed of four inserted lightweight neural layers: the Neural Experience Memory Layer located in the intermediate layers of the Diffusion Transformer (DiT) provides task-relevant execution context; the Neural Anomaly Detection Layer after the state prediction head monitors the divergence between predicted and actual states in real time; the Neural Policy Routing Layer dynamically selects direct execution, conservative replanning, or rollback recovery based on the anomaly severity; and the Neural Action Correction Layer refines the generated action chunks using execution diagnostics. Unlike naive feature fusion, the memory, anomaly detection, and correction modules are deeply integrated into the Cosmos3 forward path in a differentiable manner, with only the final routing decision being a discrete supervised one.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。