arXiv:2505.01931cs.ROcs.AI2025-05被引 4

用大模型让便宜机器人听懂指令并自主避障

Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics

  • 用GPT-4代替状态机,通过提示词实现任务逻辑推理
  • 在Petoi Bittle上实现96%-100%语义任务成功率
  • 无需微调,低成本硬件即可实现上下文感知导航

传统机器人导航依赖硬编码状态机和纯几何路径规划,难以理解高层语义指令。本文评估GPT-4作为路径规划器的能力,并提出一种融合GPT-4语义推理与A*算法的混合规划框架,部署于运行ROS2 Humble的低成本机器人平台。该方法通过提示词驱动的GPT-4模块处理任务逻辑,取代显式有限状态机(FSM)编码,同时保留A*的精确路径计算。GPT-4模块可识别环境语义线索(如有毒障碍物、拥挤区域),动态调整占用栅格以施加语义约束。实验在搭载顶置摄像头和Raspberry Pi Zero 2W的Petoi Bittle机器人上进行,对比经典A*与GPT-4辅助规划。结果表明:虽然A*在基础路径生成中更快更准,但集成GPT-4的系统在语义任务上成功率高达96%-100%,而纯几何规划无法完成此类任务。本工作证明,仅通过少量硬件与无微调的大语言模型,廉价机器人也能实现智能、上下文感知的行为。

原文摘要 · Abstract (English)

Classical robot navigation often relies on hardcoded state machines and purely geometric path planners, limiting a robot's ability to interpret high-level semantic instructions. In this paper, we first assess GPT-4's ability to act as a path planner compared to the A* algorithm, then present a hybrid planning framework that integrates GPT-4's semantic reasoning with A* on a low-cost robot platform operating on ROS2 Humble. Our approach eliminates explicit finite state machine (FSM) coding by using prompt-based GPT-4 reasoning to handle task logic while maintaining the accurate paths computed by A*. The GPT-4 module provides semantic understanding of instructions and environmental cues (e.g., recognizing toxic obstacles or crowded areas to avoid, or understanding low-battery situations requiring alternate route selection), and dynamically adjusts the robot's occupancy grid via obstacle buffering to enforce semantic constraints. We demonstrate multi-step reasoning for sequential tasks, such as first navigating to a resource goal and then reaching a final destination safely. Experiments on a Petoi Bittle robot with an overhead camera and Raspberry Pi Zero 2W compare classical A* against GPT-4-assisted planning. Results show that while A* is faster and more accurate for basic route generation and obstacle avoidance, the GPT-4-integrated system achieves high success rates (96-100%) on semantic tasks that are infeasible for pure geometric planners. This work highlights how affordable robots can exhibit intelligent, context-aware behaviors by leveraging large language model reasoning with minimal hardware and no fine-tuning.

语义导航大模型应用低成本机器人混合规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。