arXiv:2604.13345cs.CV2026-04

用树莓派实现多智能体目标检测,通过聊天机器人控制

Multi-Agent Object Detection Framework Based on Raspberry Pi YOLO Detector and Slack-Ollama Natural Language Interface

  • 用Slack聊天机器人和本地Ollama模型实现智能体交互控制
  • 在单个树莓派上运行YOLO检测、跟踪与自然语言接口
  • 适合边缘计算与低成本智能系统开发人员参考

本文设计并实现了基于边缘计算的目标检测系统,采用多智能体协同架构,在资源受限的树莓派平台上集成自然语言控制与计算机视觉功能。系统通过自研事件驱动的消息交换机制,协调本地运行的YOLO视觉智能体、Slack聊天机器人及本地Ollama大语言模型,实现目标检测与追踪。相比依赖云端的方案,该方法无需外部资源,具备快速原型开发优势。实验揭示了低成本硬件在集中式多智能体系统中的性能瓶颈,并对比分析了本地化部署与云依赖方案的差异。

原文摘要 · Abstract (English)

The paper presents design and prototype implementation of an edge based object detection system within the new paradigm of AI agents orchestration. It goes beyond traditional design approaches by leveraging on LLM based natural language interface for system control and communication and practically demonstrates integration of all system components into a single resource constrained hardware platform. The method is based on the proposed multi-agent object detection framework which tightly integrates different AI agents within the same task of providing object detection and tracking capabilities. The proposed design principles highlight the fast prototyping approach that is characteristic for transformational potential of generative AI systems, which are applied during both development and implementation stages. Instead of specialized communication and control interface, the system is made by using Slack channel chatbot agent and accompanying Ollama LLM reporting agent, which are both run locally on the same Raspberry Pi platform, alongside the dedicated YOLO based computer vision agent performing real time object detection and tracking. Agent orchestration is implemented through a specially designed event based message exchange subsystem, which represents an alternative to completely autonomous agent orchestration and control characteristic for contemporary LLM based frameworks like the recently proposed OpenClaw. Conducted experimental investigation provides valuable insights into limitations of the low cost testbed platforms in the design of completely centralized multi-agent AI systems. The paper also discusses comparative differences between presented approach and the solution that would require additional cloud based external resources.

边缘计算多智能体YOLO自然语言控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。