arXiv:2506.03863cs.ROcs.LG2025-06ICML被引 16

通过旋转增强量化避免技能代码崩溃,提升机器人复杂动作学习效果。

STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantization

  • 用旋转梯度机制防止代码本坍缩,使同一技能点更分散或聚集
  • 在LIBERO基准上比基线提升约12%,真实场景任务表现更优
  • 适合需要连贯动作生成的机器人操控研究者

将复杂动作转化为离散技能抽象在机器人操作中展现出强大潜力。现有方法主要依赖潜在变量模型(如VQ-VAE)通过学习向量(代码本)来获取技能抽象,但存在代码本坍缩及难以建模技能间因果关系的问题。为此,我们提出技能训练与旋转增强(STAR)框架,推动技能学习与组合以完成复杂行为。具体而言,为防止代码本坍缩,设计了旋转增强残差技能量化(RaRSQ),通过基于旋转的梯度机制将编码输出间的相对角度引入梯度流中,依据梯度方向强制同技能点相互推远或拉近。此外,为捕捉技能间的因果关系,提出因果技能变压器(CST),通过自回归机制显式建模技能表示间的依赖关系,实现连贯动作生成。大量实验表明,STAR在LIBERO基准和真实世界任务中均优于基线,性能提升约12%。

原文摘要 · Abstract (English)

Transforming complex actions into discrete skill abstractions has demonstrated strong potential for robotic manipulation. Existing approaches mainly leverage latent variable models, e.g., VQ-VAE, to learn skill abstractions through learned vectors (codebooks), while they suffer from codebook collapse and modeling the causal relationship between learned skills. To address these limitations, we present \textbf{S}kill \textbf{T}raining with \textbf{A}ugmented \textbf{R}otation (\textbf{STAR}), a framework that advances both skill learning and composition to complete complex behaviors. Specifically, to prevent codebook collapse, we devise rotation-augmented residual skill quantization (RaRSQ). It encodes relative angles between encoder outputs into the gradient flow by rotation-based gradient mechanism. Points within the same skill code are forced to be either pushed apart or pulled closer together depending on gradient directions. Further, to capture the causal relationship between skills, we present causal skill transformer (CST) which explicitly models dependencies between skill representations through an autoregressive mechanism for coherent action generation. Extensive experiments demonstrate the superiority of STAR on both LIBERO benchmark and realworld tasks, with around 12\% improvement over the baselines.

机器人技能量化因果建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。