arXiv:2510.23856cs.AI2025-10AAAI被引 7

IBM打造通用智能体CUGA,实现在企业生产环境的落地验证。

From Benchmarks to Business Impact: Deploying IBM Generalist Agent in Enterprise Production

  • 采用分层规划-执行架构,基于分析驱动设计提升任务处理能力。
  • 在26项人才招聘任务中接近专用智能体精度,开发成本显著降低。
  • 为通用智能体进入企业级应用提供技术与组织双维度实践参考。

智能体正快速推进数字工作自动化,但企业面临的挑战在于从原型走向可交付业务价值的部署系统。这一过程受制于框架碎片化、开发缓慢及缺乏标准化评估体系。通用智能体虽在学术基准上表现优异,具备跨任务、跨应用和多模态灵活性,但在企业生产环境中的应用仍有限。本文报告了IBM开发并试点运行的计算机通用智能体(CUGA),其已开源(https://github.com/cuga-project/cuga-agent)。CUGA采用分层规划-执行架构,具有坚实的分析基础,在AppWorld和WebArena上达到领先性能。除基准测试外,还在BPO-TA(含13个分析端点的26项任务)的人才招聘领域试点,满足企业对可扩展性、可审计性、安全性和治理的要求。初步评估显示,其精度接近专用智能体,且具备缩短开发周期与降低成本的潜力。本研究贡献包括:提供通用智能体在企业规模运行的早期证据,以及由此提炼出的技术与组织经验。文中还提出推动研究级架构向企业就绪系统演进的路径与下一步建议。

原文摘要 · Abstract (English)

Agents are rapidly advancing in automating digital work, but enterprises face a harder challenge: moving beyond prototypes to deployed systems that deliver measurable business value. This path is complicated by fragmented frameworks, slow development, and the absence of standardized evaluation practices. Generalist agents have emerged as a promising direction, excelling on academic benchmarks and offering flexibility across task types, applications, and modalities. Yet, evidence of their use in production enterprise settings remains limited. This paper reports IBM's experience developing and piloting the Computer Using Generalist Agent (CUGA), which has been open-sourced for the community (https://github.com/cuga-project/cuga-agent). CUGA adopts a hierarchical planner--executor architecture with strong analytical foundations, achieving state-of-the-art performance on AppWorld and WebArena. Beyond benchmarks, it was evaluated in a pilot within the Business-Process-Outsourcing talent acquisition domain, addressing enterprise requirements for scalability, auditability, safety, and governance. To support assessment, we introduce BPO-TA, a 26-task benchmark spanning 13 analytics endpoints. In preliminary evaluations, CUGA approached the accuracy of specialized agents while indicating potential for reducing development time and cost. Our contribution is twofold: presenting early evidence of generalist agents operating at enterprise scale, and distilling technical and organizational lessons from this initial pilot. We outline requirements and next steps for advancing research-grade architectures like CUGA into robust, enterprise-ready systems.

智能体企业应用通用代理自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。