用几何一致性提升物理AI动作生成的稳定性,无需额外训练。
Geometry Guided Self-Consistency for Physical AI

- 并行生成多条动作片段,基于欧氏距离聚类选最优
- 在多种模型上提升成功率最高达13.3%,延迟几乎不变
- 适合追求高鲁棒性的物理智能系统部署
当前先进的物理AI模型通过扩散或流匹配,在推理时生成一系列动作片段,逐步将初始噪声样本优化为动作轨迹。由于该过程具有随机性,单次采样易出错,且错误会随连续多轮迭代累积。本文提出KeyStone,一种基于扩散的动作生成推理时自一致性方法:从同一模型上下文并行生成K个候选动作片段,在连续动作空间中聚类,并返回最大簇的中心点(medoid)——无需额外模型。该方法实用的两大原因是:第一,动作轨迹紧凑,扩散推理受内存带宽限制,有充足算力可并行运行K条轨迹而无额外耗时;第二,动作片段具有几何结构,欧氏距离直接反映物理相似性,因此聚类选择无需学习判别器。在多种视觉-语言-动作模型(VLAs)和世界-动作模型(WAMs)上,KeyStone相比单轨迹采样最高提升任务成功率13.3%,与基于模型的选择器精度相当,且无需训练。代码已开源:https://github.com/dywsjtu/keystone。
原文摘要 · Abstract (English)
State-of-the-art physical AI models generate a chunk of actions per inference through diffusion or flow matching, iteratively refining an initial noise sample into an action trajectory. Because this inference process is inherently stochastic, committing to a single trajectory per round is brittle, and this brittleness compounds across the many sequential rounds that comprise a complete episode. We introduce KeyStone, an inference-time self-consistency method for diffusion-based action generation that draws $K$ candidate action chunks in parallel from a shared model context, clusters them in continuous action space, and returns the medoid of the largest cluster -- no additional model required. Two properties make this practical. First, the compact nature of action trajectories makes diffusion inference memory-bandwidth bound, leaving spare compute capacity to run $K$ chains in parallel with no additional wall-clock latency. Second, unlike token or pixel spaces where distance carries no semantic meaning and selection requires a learned judge, action chunks are geometrically structured such that Euclidean distance directly reflects physical similarity, making selection principled and judge-free. Across diverse vision-language-action models (VLAs) and world-action models (WAMs), KeyStone improves task success rates by up to \textbf{13.3\%} over single-trajectory sampling with negligible latency overhead, while having on par accuracy with model-based selectors at no training cost. We open source KeyStone at https://github.com/dywsjtu/keystone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。