为智能代理制定服务等级协议,解决AI系统质量保障难题。
AgentSLA : Towards a Service Level Agreement for AI Agents
- 基于ISO/IEC 25010标准构建AI代理质量模型。
- 提出专用语言支持定义智能代理的服务协议。
- 适合需保障AI代理服务质量的系统开发者使用。
AI组件正日益成为各类软件系统的核心功能模块。这些组件常以智能代理形式实现,相较于单纯的大型语言模型集成,具备更高自主性,推动从“模型即服务”向“代理即服务”转变,也带来了新的开发挑战。尽管已有支持智能代理的设计、实现与部署的工具,但对其服务质量(QoS)的规范及服务等级协议(SLA)的定义仍属开放问题,制约了智能系统的质量保障。这主要源于对AI组件质量的界定模糊,导致质量保证方法缺乏共识。为此,本文提出一个基于ISO/IEC 25010标准的AI代理质量模型,并设计一种领域特定语言,用于支持智能代理所提供服务的SLA定义。
原文摘要 · Abstract (English)
AI components are increasingly becoming a key element of all types of software systems to enhance their functionality. These AI components are often implemented as AI Agents, offering more autonomy than a plain integration of Large Language Models (LLMs), moving from a Model-as-a-Service paradigm to an Agent-as-a-Service one, bringing new challenges to the development of smart software systems. Indeed, while support for the design, implementation, and deployment of those agents exist, the specification of Quality of Service (QoS) and definition of Service Level Agreements (SLAs) aspects for those agents, important to ensure the quality of the resulting systems, remains an open challenge. Part of this is due to the difficulty to clearly define quality in the context of AI components, resulting in a lack of consensus on how to best approach Quality Assurance (QA) for these types of systems. To address this challenge, this paper proposes both a quality model for AI agents based on the ISO/IEC 25010 standard, and a domain specific language to support the definition of SLAs for the services provided by these AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。