arXiv:2511.03497cs.ROcs.AI2025-11被引 3

用大模型分析机器人数据,让自然语言直接操控机器人日志

ROSBag MCP Server: Analyzing Robot Data with LLMs for Agentic Embodied AI Applications

  • 构建MCP服务器,通过自然语言调用大模型解析ROS/ROS2日志
  • 测试8个主流模型发现柯基K2和Claude Sonnet 4工具调用能力最强
  • 支持移动机器人轨迹、激光扫描等数据的可视化与筛选分析

具身智能与代理型AI是当前人工智能与机器人领域的两大前沿方向,而模型上下文协议(MCP)正成为代理应用的关键支撑。然而,两者交汇处——代理型具身智能的研究仍较为匮乏。本文提出一个针对ROS与ROS 2数据包(bag)的MCP服务器,使用户可通过大语言模型(LLM)和视觉语言模型(VLM)以自然语言对机器人数据进行分析、可视化与处理。系统集成机器人领域知识构建专用工具,初期聚焦移动机器人,原生支持轨迹、激光扫描、变换关系及时间序列数据的解析。此外,兼容标准ROS 2命令行工具(如ros2 bag list、ros2 bag info),并支持按主题或时间范围过滤数据包。配套提供轻量级界面,用于对比不同LLM在该任务上的表现,涵盖专有模型(Anthropic、OpenAI)与开源模型(通过Groq部署)。实验评估了8个先进模型的工具调用能力,结果表明:柯基K2与Claude Sonnet 4表现显著领先;成功度受工具描述格式、参数数量及可用工具数量等多重因素影响。代码已开源,采用宽松许可协议。

原文摘要 · Abstract (English)

Agentic AI systems and Physical or Embodied AI systems have been two key research verticals at the forefront of Artificial Intelligence and Robotics, with Model Context Protocol (MCP) increasingly becoming a key component and enabler of agentic applications. However, the literature at the intersection of these verticals, i.e., Agentic Embodied AI, remains scarce. This paper introduces an MCP server for analyzing ROS and ROS 2 bags, allowing for analyzing, visualizing and processing robot data with natural language through LLMs and VLMs. We describe specific tooling built with robotics domain knowledge, with our initial release focused on mobile robotics and supporting natively the analysis of trajectories, laser scan data, transforms, or time series data. This is in addition to providing an interface to standard ROS 2 CLI tools ("ros2 bag list" or "ros2 bag info"), as well as the ability to filter bags with a subset of topics or trimmed in time. Coupled with the MCP server, we provide a lightweight UI that allows the benchmarking of the tooling with different LLMs, both proprietary (Anthropic, OpenAI) and open-source (through Groq). Our experimental results include the analysis of tool calling capabilities of eight different state-of-the-art LLM/VLM models, both proprietary and open-source, large and small. Our experiments indicate that there is a large divide in tool calling capabilities, with Kimi K2 and Claude Sonnet 4 demonstrating clearly superior performance. We also conclude that there are multiple factors affecting the success rates, from the tool description schema to the number of arguments, as well as the number of tools available to the models. The code is available with a permissive license at https://github.com/binabik-ai/mcp-rosbags.

具身智能大模型机器人数据自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。