arXiv:2608.28995cs.ROcs.CV2026-08

提出一种离散潜空间规划的导航模型,让机器人实时决策更高效。

Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution

论文配图:Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution
图 1 · 摘自论文原文
  • 在统一潜空间中进行离散规划,避免像素解码开销
  • 结合动力学感知代价评估候选动作,提升规划效率
  • 适合需要快速响应的物理机器人控制任务

世界模型使机器人能够预演未来,但实时控制受限于生成模型与规划器之间的表征错位:二者运行在分离的流形上,导致规划器无法共享结构,必须将每个候选方案解码回高维像素空间进行评估,这一过程成为物理硬件实时控制的主要瓶颈。本文提出Hydra,一种离散世界动作模型,通过将规划器(采样与评估)嵌入模型内部,弥合这一鸿沟。Hydra建立视觉状态、物理姿态与控制动作的统一潜空间,并通过模态特定的向量量化瓶颈,将其压缩为离散的运动动力学意图与视觉状态词汇表。由于候选动作直接从该共享潜空间采样,采样基于模型自身对观测的理解而非盲目尝试,评估也在离散空间内原生完成:通过动力学-感知代价对候选动作排序,无需解码至像素。此即离散潜空间规划(DLP)。由于仅对离散意图规划难以生成连续控制指令,Hydra 配合条件流匹配,将选定意图映射为连续轨迹以供执行。在两个物理机器人平台上评估,Hydra 在目标导向规划上优于现有世界模型,同时在闭环执行性能上达到或超越领先反应式基础策略。

原文摘要 · Abstract (English)

World models let robots imagine possible futures, but exploiting this capability for real-time control is bottlenecked by a representation misalignment: the generative model and the planner operate on decoupled manifolds, so the planner has no shared structure to search over and must instead decode every candidate back into high-dimensional pixel space to evaluate it. This decoding step is a major obstacle to real-time control on physical hardware. In this paper, we present Hydra, a discrete World Action Model that closes this gap by moving the planner, both the sampler and the evaluator, inside the model. Hydra establishes a unified latent manifold over visual states, physical poses, and control actions, then compresses this manifold through modality-specific Vector-Quantized bottlenecks into discrete vocabularies of kinodynamic intents and visual states. Because candidates are now drawn directly from this shared manifold, sampling is informed by the model's own understanding of the observation rather than proposed blind, and evaluation happens natively within the discrete space: candidates are ranked by a Kinematic-Perceptual Cost, without ever decoding to pixels. We term this Discrete Latent Planning (DLP). Because planning over discrete intents alone cannot supply the smooth, continuous commands physical actuation requires, Hydra pairs DLP with conditional Flow Matching, which maps each selected intent to a continuous trajectory for execution. Evaluated on two physical robotic platforms, Hydra outperforms state-of-the-art world models in goal-directed planning, while matching or exceeding the closed-loop execution capabilities of leading reactive foundation policies.

机器人控制世界模型离散规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。