混合路由让智能体高效决策,本地与云端协同处理任务。
Toward Super Agent System with Hybrid AI Routers
- 用混合AI路由器按任务复杂度动态选本地或云端模型
- 支持本地运行为主、云端协作为辅的轻量级架构设计
- 适合移动端和机器人等边缘设备部署
基于大语言模型的AI智能体正重塑世界应用。超级智能体可通过准确理解用户意图并调用合适工具,完成摘要、编程、研究等多种任务。然而要实现真实场景下的规模化部署,需显著优化效率与成本。本文提出一种由混合AI路由器驱动的超级智能体系统:接收用户请求后,先识别意图,再路由至具备相应工具的专业任务智能体,或自动生成智能体工作流。实践中,多数应用需在手机、机器人等边缘设备上作为AI助手运行。由于不同语言模型能力差异大,且云端模型常伴随高计算开销、延迟和隐私风险,本文探索混合模式——路由器根据任务复杂度动态选择本地或云端模型。最后,提出一个增强型本地超级智能体蓝图:借助多模态模型与边缘硬件进步,预计绝大多数计算可在本地完成,仅在必要时联动云端。这一架构使超级智能体有望在未来近期内无缝融入日常生活。
原文摘要 · Abstract (English)
AI Agents powered by Large Language Models are transforming the world through enormous applications. A super agent has the potential to fulfill diverse user needs, such as summarization, coding, and research, by accurately understanding user intent and leveraging the appropriate tools to solve tasks. However, to make such an agent viable for real-world deployment and accessible at scale, significant optimizations are required to ensure high efficiency and low cost. This position paper presents a design of the Super Agent System powered by the hybrid AI routers. Upon receiving a user prompt, the system first detects the intent of the user, then routes the request to specialized task agents with the necessary tools or automatically generates agentic workflows. In practice, most applications directly serve as AI assistants on edge devices such as phones and robots. As different language models vary in capability and cloud-based models often entail high computational costs, latency, and privacy concerns, we then explore the hybrid mode where the router dynamically selects between local and cloud models based on task complexity. Finally, we introduce the blueprint of an on-device super agent enhanced with cloud. With advances in multi-modality models and edge hardware, we envision that most computations can be handled locally, with cloud collaboration only as needed. Such architecture paves the way for super agents to be seamlessly integrated into everyday life in the near future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。