用轻量上下文迁移实现跨世界动作模型高效知识传递
CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models

- 通过文本嵌入空间的紧凑上下文传递知识,避免复杂匹配
- 仅1.17%可训练参数即达86.1%成功率,接近全量微调效果
- 适合需要低资源迁移的机器人控制场景
世界动作模型(WAMs)为具身控制提供了强大的生成框架,但因潜在接口不匹配、适应成本高及传统蒸馏目标僵化,跨异构WAM的知识迁移仍具挑战。本文提出参数高效的上下文知识迁移框架CKT-WAM,将教师模型的中间隐藏状态经压缩器的可学习查询交叉注意力处理后,通过始终开启的通用适配器、轻量路由模块和稀疏激活的专业适配器转换为紧凑上下文,注入学生模型的条件文本嵌入中。实验表明,CKT-WAM在LIBERO-Plus上零样本泛化能力显著提升,总成功率达86.1%,仅需1.17%可训练参数,接近全微调性能;在真实世界多步长任务中平均成功率83.3%,表现最优。代码已开源。
原文摘要 · Abstract (English)
World action models (WAMs) provide a powerful generative framework for embodied control, yet transferring knowledge across heterogeneous WAMs remains challenging due to mismatched latent interfaces, high adaptation cost, and the rigidity of conventional distillation objectives. We propose \textbf{CKT-WAM}, a parameter-efficient \textbf{C}ontext \textbf{K}nowledge \textbf{T}ransfer framework that transfers teacher WAM's knowledge into a student WAM through a compact context in the text embedding space, rather than output imitation or dense hidden-state matching. Specifically, CKT-WAM extracts intermediate teacher hidden states, reduces the number of tokens via compressors' learnable-query cross attention (LQCA), and transforms them through an always-on generalized adapter, a lightweight router, and sparsely activated specialized adapters. The resulting context is then appended to the student's conditioning textual embeddings, thereby injecting the transferred knowledge into the student with minimal architectural modification. Experiments show that CKT-WAM consistently improves zero-shot generalization and achieves the best overall performance on LIBERO-Plus, reaching 86.1\% total success rate with only 1.17\% trainable parameters, while approaching full fine-tuning performance. Beyond simulation, CKT-WAM also demonstrates strong real-world long-horizon manipulation ability, achieving the best average success rate of 83.3\% across four multi-step and long-horizon tasks. Code is available at https://github.com/YuhuaJiang2002/CKT-WAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。