用锚点扩散模型实现低延迟、高鲁棒的移动操作控制。
AnchorVLA: Anchored Diffusion for Efficient End-to-End Mobile Manipulation
- 以锚点轨迹为起点,局部扩散生成多策略动作,减少推理开销。
- 在多个任务上成功率提升,扰动下仍保持稳定,延迟低于100ms。
- 适合对实时性要求高的机器人操作场景,如工业搬运与家庭服务。
移动操作的核心挑战在于,既要保留多种合理动作策略,又需在执行中保持响应性。杂乱场景中的瓶子可有多种有效抓取方式,行为鲁棒性依赖于动作多样性的维持和对环境变化的即时响应。扩散策略因能建模多模态动作分布而具有优势,但全迭代去噪在控制时成本过高。动作分段虽能摊薄计算,却导致部分开环行为,小误差累积成漂移。本文提出AnchorVLA,一种基于扩散的视觉-语言-动作(VLA)策略,核心思想是:当采样起始于合理动作流形附近时,无需完整去噪即可恢复多模态有效动作。AnchorVLA结合轻量级VLA适配主干与锚定扩散动作头,采用截断扩散调度,在锚点附近进行局部去噪,保留多模态生成能力的同时降低闭环控制的推理成本。为缓解分段带来的漂移,引入轻量级残差修正模块,在测试时每步进行高频自校正。在多样化移动操作任务中,AnchorVLA在扰动和分布偏移下均提升成功率与稳定性,同时保持低延迟推理(<100ms)。代码已开源:https://github.com/jason-lim26/AnchorVLA。
原文摘要 · Abstract (English)
A central challenge in mobile manipulation is preserving multiple plausible action models while remaining reactive during execution. A bottle in a cluttered scene can often be approached and grasped in multiple valid ways. Robust behavior depends on preserving this action diversity while remaining reactive as the scene evolves. Diffusion policies are appealing because they model multimodal action distributions rather than collapsing to one solution. But in practice, full iterative denoising is costly at control time. Action chunking helps amortize inference, yet it also creates partially open-loop behavior, allowing small mismatches to accumulate into drift. We present AnchorVLA, a diffusion-based VLA policy for mobile manipulation built on the core insight that when sampling begins near a plausible solution manifold, extensive denoising is unnecessary to recover multimodal, valid actions. AnchorVLA combines a lightweight VLA adaptation backbone with an anchored diffusion action head, which denoises locally around anchor trajectories using a truncated diffusion schedule. This retains multimodal action generation while reducing inference cost for closed-loop control. Crucially, to mitigate chunking-induced drift, we introduce a test-time self-correction mechanism via a lightweight residual correction module that makes high-frequency, per-step adjustments during rollout. Across diverse mobile manipulation tasks, AnchorVLA improves success and stability under disturbances and distribution shifts while maintaining low-latency inference. The source code is made available at https://github.com/jason-lim26/AnchorVLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。