arXiv:2601.11269cs.CVcs.AI2026-01被引 2

用大模型蒸馏小模型,让机器人在少数据下也能高效学习视觉动作策略。

X-Distill: Cross-Architecture Vision Distillation for Visuomotor Learning

  • 用DINOv2大模型蒸馏ResNet-18小模型,迁移强视觉先验
  • 在34个仿真+5个真实任务上超越从头训练和微调的基线
  • 适合资源有限、需高效视觉学习的机器人应用

视觉运动策略常依赖大型预训练视觉变压器(ViTs)以获得强大泛化能力,但其高数据需求在多数机器人学习场景中构成挑战。本文提出X-Distill,一种简单而高效的跨架构知识蒸馏方法,融合两种结构优势。该方法在ImageNet通用数据集上离线执行跨架构知识蒸馏,将大型冻结DINOv2教师模型的丰富视觉表征迁移到紧凑的ResNet-18学生模型。随后,该蒸馏后的编码器与扩散策略头在目标操作任务上联合微调。在34个仿真基准和5个复杂真实任务上的大量实验表明,该方法始终优于使用从零开始训练的ResNet或微调的DINOv2编码器的策略。值得注意的是,X-Distill还超越了利用点云观测或更大视觉语言模型的3D编码器。本工作凸显了简单且合理的蒸馏策略在数据高效机器人操作中的卓越性能。

原文摘要 · Abstract (English)

Visuomotor policies often leverage large pre-trained Vision Transformers (ViTs) for their powerful generalization capabilities. However, their significant data requirements present a major challenge in the data-scarce context of most robotic learning settings, where compact CNNs with strong inductive biases can be more easily optimized. To address this trade-off, we introduce X-Distill, a simple yet highly effective method that synergizes the strengths of both architectures. Our approach involves an offline, cross-architecture knowledge distillation, transferring the rich visual representations of a large, frozen DINOv2 teacher to a compact ResNet-18 student on the general-purpose ImageNet dataset. This distilled encoder, now endowed with powerful visual priors, is then jointly fine-tuned with a diffusion policy head on the target manipulation tasks. Extensive experiments on $34$ simulated benchmarks and $5$ challenging real-world tasks demonstrate that our method consistently outperforms policies equipped with from-scratch ResNet or fine-tuned DINOv2 encoders. Notably, X-Distill also surpasses 3D encoders that utilize privileged point cloud observations or much larger Vision-Language Models. Our work highlights the efficacy of a simple, well-founded distillation strategy for achieving state-of-the-art performance in data-efficient robotic manipulation.

视觉运动知识蒸馏机器人学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。