arXiv:2511.18082cs.CVcs.RO2025-11被引 4

用动作引导知识蒸馏,让大模型变小但依然精准高效。

ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Models

  • 以动作先验为指导,通过图结构建模动作演化过程。
  • 压缩后模型计算量减半以上,推理速度提升1.67倍。
  • 适合部署在机器人等资源受限场景的视觉语言动作系统。

近期视觉-语言-动作(VLA)模型展现出强大灵活性与泛化能力,但其在机器人操作中的应用受限于高计算开销和推理延迟。本文提出ActDistill,一种通用的动作引导自衍生蒸馏框架,将任意现有VLA模型的动作预测能力迁移到轻量级学生模型。不同于以往侧重视觉-语言关联的效率策略,ActDistill利用动作先验引导知识迁移与模型压缩,实现面向动作的高效性。具体而言,采用训练良好的VLA模型作为教师,引入图结构封装策略显式建模动作预测的层级演化过程。学生模型基于图封装的教师构建,并配备动态路由模块,依据动作预测需求自适应选择计算路径,在层级图监督下确保平滑高效的演化。推理时移除图相关辅助组件,仅执行动态路由层,以最小计算量实现高精度动作预测。在具身任务基准上的实验表明,ActDistill在保持或超越全尺寸模型性能的同时,计算量减少超50%,最快可提速1.67倍,为高效具身智能提供通用范式。

原文摘要 · Abstract (English)

Recent Vision-Language-Action (VLA) models have shown impressive flexibility and generalization, yet their deployment in robotic manipulation remains limited by heavy computational overhead and inference latency. In this work, we present ActDistill, a general action-guided self-derived distillation framework that transfers the action prediction capability of any existing VLA model to a lightweight counterpart. Unlike previous efficiency strategies that primarily emphasize vision-language correlations, ActDistill leverages action priors to guide knowledge transfer and model compression, achieving action-oriented efficiency for VLA models. Specifically, we employ a well-trained VLA model as the teacher and introduce a graph-structured encapsulation strategy to explicitly model the hierarchical evolution of action prediction. The student model, derived from the graph-encapsulated teacher, is further equipped with a dynamic router that adaptively selects computation paths based on action prediction demands, guided by hierarchical graph-informed supervision to ensure smooth and efficient evolution. During inference, graph-related auxiliary components are removed, allowing the student to execute only dynamically routed layers and predict high-precision actions with minimal computation and latency. Experiments on embodied benchmarks demonstrate that ActDistill achieves comparable or superior performance to full-scale VLA models while reducing computation by over 50% with up to 1.67 times speedup, thereby establishing a general paradigm toward efficient embodied intelligence.

模型压缩动作预测具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。