arXiv:2601.02577cs.AIastro-ph.IM2026-01被引 9

统一多平台大模型代理接口,让开发更简单可靠。

Orchestral AI: A Framework for Agent Orchestration

  • 用统一格式抽象消息、工具和调用,跨厂商无缝衔接
  • 自动从类型提示生成工具描述,无需手动编写
  • 支持调试与实时交互,适合科研与生产部署

大模型代理框架的快速涌现迫使开发者在厂商专属 SDK 的锁定与复杂的多包生态之间做出选择。跨多个大模型提供商进行工具调用仍是核心工程挑战,因接口碎片化、消息格式不兼容及流式处理与工具调用行为不一致,导致难以构建可移植、可靠的代理系统。我们提出 Orchestral,一个轻量级 Python 框架,为主要厂商提供统一、类型安全的代理构建接口,同时保持科学计算与生产部署所需的简洁性。Orchestral 定义了消息、工具和大模型使用的一致通用表示,可在各厂商间无缝运行,消除手动格式转换,降低框架带来的复杂性。通过 Python 类型提示自动生成功能描述,无需手工编写,且在跨厂商边界保持类型安全。同步执行模型支持流式输出,实现确定性行为、便捷调试与实时交互,无需依赖服务器。其模块化架构清晰分离厂商集成、工具执行、对话编排与用户界面,支持扩展而不产生架构耦合。Orchestral 支持高级代理功能,包括丰富工具调用、上下文压缩、工作区沙箱、用户审批流程、子代理、记忆管理与 MCP 集成。

原文摘要 · Abstract (English)

The rapid proliferation of LLM agent frameworks has forced developers to choose between vendor lock-in through provider-specific SDKs and complex multi-package ecosystems that obscure control flow and hinder reproducibility. Integrating tool calling across multiple LLM providers remains a core engineering challenge due to fragmented APIs, incompatible message formats, and inconsistent streaming and tool-calling behavior, making it difficult to build portable, reliable agent systems. We introduce Orchestral, a lightweight Python framework that provides a unified, type-safe interface for building LLM agents across major providers while preserving the simplicity required for scientific computing and production deployment. Orchestral defines a single universal representation for messages, tools, and LLM usage that operates seamlessly across providers, eliminating manual format translation and reducing framework-induced complexity. Automatic tool schema generation from Python type hints removes the need for handwritten descriptors while maintaining type safety across provider boundaries. A synchronous execution model with streaming support enables deterministic behavior, straightforward debugging, and real-time interaction without introducing server dependencies. The framework's modular architecture cleanly separates provider integration, tool execution, conversation orchestration, and user-facing interfaces, enabling extensibility without architectural entanglement. Orchestral supports advanced agent capabilities found in larger frameworks, including rich tool calling, context compaction, workspace sandboxing, user approval workflows, sub-agents, memory management, and MCP integration.

大模型代理框架设计工具调用Python

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。