用自然语言和手势让普通人轻松编程机器人。
Automating Manual Tasks through Intuitive Robot Programming and Cognitive Robotics
- 通过大模型和视觉技术将人话转为机器人指令。
- 系统用提问和可视化反馈帮助用户修正程序。
- 适合非专业用户快速上手机器人开发。
本文提出一种受人类自然交互启发的直观机器人编程方法。利用大型语言模型（LLMs）和计算机视觉（CV），将自然语言和辅助手势转化为机器人程序。通过清晰的问题和可视化反馈，用户可审查并调整生成的程序，从而确保安全性、透明性和用户接受度。
原文摘要 · Abstract (English)
This paper presents a novel concept for intuitive end-user programming of robots, inspired by natural interaction between humans. Natural language and supportive gestures are translated into robot programs using large language models (LLMs) and computer vision (CV). Through equally natural system feedback in the form of clarification questions and visual representations, the generated program can be reviewed and adjusted, thereby ensuring safety, transparency, and user acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。