arXiv:2510.10903cs.RO2025-10综述被引 38

系统梳理机器人抓取的感知-规划-控制全链条方法与瓶颈。

Towards a Unified Understanding of Robot Manipulation: A Comprehensive Survey

  • 按语言、代码、3D表示等扩展高层规划,细分学习型底层控制范式。
  • 提出数据收集、利用与泛化三大核心瓶颈分类体系。
  • 适合入门者快速定位方向,也供专家参考完整技术图谱。

具身智能近年来取得显著进展,得益于计算机视觉、自然语言处理以及大规模多模态模型的发展。其中,机器人操作是核心挑战之一,需融合感知、规划与控制以在多样且非结构化环境中实现交互。本文全面综述机器人操作,涵盖基础背景、任务导向的基准与数据集,以及现有方法的统一分类体系。我们拓展了传统的高低层规划与控制划分:将高层规划延伸至语言、代码、运动、可操作性及3D表征;并基于训练范式(输入建模、隐空间学习、策略学习)建立新的低层学习型控制分类。此外,首次提出关键瓶颈的专门分类,聚焦数据收集、利用与泛化问题,并详尽回顾真实应用场景。相比以往综述,本工作覆盖更广、洞察更深,为新手提供可读路径,为资深研究者提供结构化参考。所有相关资源(论文、开源数据集、项目)已整理于 https://github.com/BaiShuanghao/Awesome-Robotics-Manipulation。

原文摘要 · Abstract (English)

Embodied intelligence has witnessed remarkable progress in recent years, driven by advances in computer vision, natural language processing, and the rise of large-scale multimodal models. Among its core challenges, robot manipulation stands out as a fundamental yet intricate problem, requiring the seamless integration of perception, planning, and control to enable interaction within diverse and unstructured environments. This survey presents a comprehensive overview of robotic manipulation, encompassing foundational background, task-organized benchmarks and datasets, and a unified taxonomy of existing methods. We extend the classical division between high-level planning and low-level control by broadening high-level planning to include language, code, motion, affordance, and 3D representations, while introducing a new taxonomy of low-level learning-based control grounded in training paradigms such as input modeling, latent learning, and policy learning. Furthermore, we provide the first dedicated taxonomy of key bottlenecks, focusing on data collection, utilization, and generalization, and conclude with an extensive review of real-world applications. Compared with prior surveys, our work offers both a broader scope and deeper insight, serving as an accessible roadmap for newcomers and a structured reference for experienced researchers. All related resources, including research papers, open-source datasets, and projects, are curated for the community at https://github.com/BaiShuanghao/Awesome-Robotics-Manipulation.

机器人操作综述具身智能多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。