让机器人控制策略随操作阶段动态调整,提升抓取成功率。
PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policies

- 根据操作阶段动态调节低秩适配方向,实现时序条件化更新。
- 在LIBERO数据集上比高秩基线提升12.2%成功率,优于其他LoRA变体。
- 适用于需要精细动作控制的连续动作视觉-语言-动作模型部署。
参数高效微调(PEFT)是适配预训练视觉-语言-动作(VLA)策略的自然方式,但多数适配器在整个控制序列中采用静态更新,忽略了连续动作操作中各阶段的差异性。操作过程包含接近、接触过渡、抓取、运输和放置等不同阶段,每个阶段需不同的适应行为。我们提出 extbf{PhaseLoRA},一种轻量级LoRA参数化方法,通过两个弱监督描述符——精细控制倾向与事件/边界强度——在每一步动作块预测时条件化适配。PhaseLoRA调节动作专家中的LoRA左因子,使有效低秩更新方向随时间变化,同时保持主干网络基本冻结。在LIBERO数据集上,PhaseLoRA相比匹配参数的高秩LoRA基线平均成功率提升12.2点,并超越更强的LoRA变体。消融实验表明,随机时间调制和标量门控无法复现完整模型性能;更新方向分析揭示了与预测控制描述符相关的结构化时序变化。这些结果确立了轨迹内条件化作为连续动作VLA策略轻量级PEFT的有效轴线。
原文摘要 · Abstract (English)
Parameter-efficient fine-tuning (PEFT) is a natural way to adapt pretrained vision-language-action (VLA) policies, but most adapter designs apply temporally static updates throughout a control rollout, overlooking the phase-dependent nature of continuous-action manipulation. Such policies traverse distinct regimes, including approach, contact transition, grasping, transport, and placement, each requiring different adaptation behaviors. We propose \textbf{PhaseLoRA}, a lightweight LoRA parameterization that conditions adaptation at each action-chunk prediction step using two weakly supervised descriptors: fine-control tendency and event/boundary intensity. PhaseLoRA modulates the LoRA left factor in the action expert, allowing the effective low-rank update direction to vary over time while keeping the backbone largely frozen. On LIBERO, PhaseLoRA improves average success rate by 12.2 points over a matched-parameter high-rank LoRA baseline and outperforms stronger LoRA variants. Ablations show that random temporal modulation and scalar gating do not reproduce the performance of the full model, while update-direction analyses reveal structured temporal variation associated with the predicted control descriptors. These results establish within-trajectory conditioning as an effective lightweight PEFT axis for continuous-action VLA policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。