arXiv:2606.08242cs.CV2026-06被引 9

轻量级世界动作模型,高效实现机器人操作的实时决策。

Light-WAM: Efficient World Action Models with State-Fusion Action Decoding

论文配图:Light-WAM: Efficient World Action Models with State-Fusion Action Decoding
图 1 · 摘自论文原文
  • 用小规模视频骨干网络在降维潜空间中进行未来视频监督
  • 通过状态融合机制单次前向传播预测动作块,减少计算开销
  • 参数仅0.44B,推理延迟72.03ms,适合实际部署的多任务机器人

世界动作模型(WAMs)通过引入未来预测作为训练目标,促进策略在表征中编码任务相关的时序结构。现有WAMs通常依赖大规模生成架构,导致训练成本高、推理延迟大,难以部署为高效的闭环策略。本文提出Light-WAM,一种面向高效机器人操作的轻量级世界动作模型。其采用紧凑的视频骨干网络,并在下采样潜空间中执行未来视频监督,降低视频联合训练成本,同时保留表征学习优势。在动作预测方面,Light-WAM引入StateFusionActionExpert,从多个骨干层读取适配状态,通过学习查询池化融合后,在单次前向传播中直接预测动作块,避免了重型生成式动作专家的使用。实验表明,Light-WAM在LIBERO上保持强性能,在RoboTwin 2.0上实现可用的多任务表现,仅需0.44B可训练参数。推理延迟为72.03ms,峰值GPU内存4.1GiB,训练吞吐量提升。

原文摘要 · Abstract (English)

World Action Models (WAMs) extend robot policy learning by incorporating future prediction as an additional training objective, encouraging the policy to encode task-relevant temporal structure in its representations. Current WAMs often rely on large-scale generative architectures that incur high training costs and inference latency, making them difficult to deploy as efficient closed-loop policies. We propose Light-WAM, a lightweight World Action Model for efficient robot manipulation. Specifically, it is built with a compact video backbone and performs future-video supervision in a downsampled latent space, reducing the cost of video co-training while retaining its benefits for representation learning. For action prediction, Light-WAM introduces the StateFusionActionExpert, which reads adapted states from multiple backbone layers, fuses them through learned-query pooling, and directly predicts action chunks in a single forward pass. This design provides an efficient interface between video backbone representations and robot actions, avoiding the need for heavy generative action experts. Experiments demonstrate that Light-WAM maintains strong performance on LIBERO and achieves usable multi-task performance on RoboTwin 2.0, while using only 0.44B trainable parameters. It also achieves 72.03ms inference latency with 4.1GiB peak GPU memory and improved training throughput.

机器人控制轻量化模型动作预测高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。