arXiv:2605.17522cs.RO2026-05被引 3

轻量级3D运动流模型,实时指导机器人抓取

RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation

论文配图:RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation
图 1 · 摘自论文原文
  • 统一感知与规划,端到端预测多帧3D运动流
  • 实测成功率提升,计算开销低于传统方法
  • 适合需要实时响应的机器人操作场景

在真实世界中进行3D环境下的规划与执行是机器人操作的核心能力。尽管已有研究探索基于预测运动流的规划方法,但现有方案通常依赖多个子模型堆叠的模块化流程,导致计算开销高、难以满足实时性要求。为此,我们提出RoboFlow4D,一种轻量级的流世界模型,通过在物理3D空间中估计时序运动,统一感知与规划。作为端到端框架,RoboFlow4D直接从视觉观测和文本指令中预测多帧3D运动流,提供显式的流引导规划以生成动作。该设计可无缝集成通用动作策略,构建高效的观察-规划-执行闭环。通过运动预测与动作控制间的慢-快协同,RoboFlow4D实现实时且资源高效的操作。在仿真与真实世界中的大量实验表明,RoboFlow4D持续提升操作成功率并显著优化计算效率,推动了具身智能中的流引导规划发展。

原文摘要 · Abstract (English)

Planning and acting in 3D environments is a fundamental capability for robotic manipulation in the real world. Although prior work has explored predictive flow planners to guide 3D manipulation, existing approaches often rely on modular pipelines stacking multiple submodels, resulting in high computational overhead and limited real-time performance. To address these challenges, we introduce RoboFlow4D, a lightweight flow world model that unifies perception and planning by estimating temporal motion in physical 3D space. As an end-to-end framework, RoboFlow4D directly predicts multi-frame 3D flows from visual observations and textual instructions, providing explicit flow-based planning to guide action generation. This design allows seamless integration with general action policies, forming an efficient observation-planning-execution closed loop. Through slow-fast collaboration between flow prediction and action control, RoboFlow4D enables real-time and resource-efficient manipulation. Extensive experiments in both simulation and real-world settings demonstrate that RoboFlow4D consistently improves manipulation success rates and computational efficiency, advancing flow-guided planning for embodied intelligence.

机器人操作运动预测实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。