arXiv:2409.05919cs.SEcs.AI2024-09被引 1

让企业无需数据科学家也能快速部署AI模型。

KModels: Unlocking AI for Business Applications

  • 用模板封装模型,开发者专注训练,用户无需懂数据科学。
  • 在本地部署三套模型,故障代码识别准确率从46%提至83%。
  • 适合不想依赖云服务或需数据本地化的传统企业使用。

随着人工智能的快速发展,将AI能力融入现有业务应用的需求日益增长。然而,AI进展与实际业务部署之间存在显著鸿沟:将高性能实验室模型部署到生产环境(尤其是本地部署)通常需要专业技能,且带来沉重的模型管理负担。KModels利用成熟工具(Kubeflow Pipelines、KServe)简化AI落地,支持开发者与使用者两端。开发者仅需专注于模型开发,并以可移植的模板形式共享;使用者无需专职数据科学家,模板已封装大部分数据科学逻辑,提供面向业务的控制能力。本文介绍KModels架构及核心设计决策,阐述其主要组件与接口。该方案高度适配本地部署,亦可运行于云环境。通过在某客户工单管理系统中成功部署三个模型验证其有效性:这些模型在客户数据中心运行,基于本地数据训练,无需数据科学家介入。其中一项模型将工单故障代码识别准确率从46%提升至83%,凸显本地化、易用型AI解决方案的巨大价值。

原文摘要 · Abstract (English)

As artificial intelligence (AI) continues to rapidly advance, there is a growing demand to integrate AI capabilities into existing business applications. However, a significant gap exists between the rapid progress in AI and how slowly AI is being embedded into business environments. Deploying well-performing lab models into production settings, especially in on-premise environments, often entails specialized expertise and imposes a heavy burden of model management, creating significant barriers to implementing AI models in real-world applications. KModels leverages proven libraries and platforms (Kubeflow Pipelines, KServe) to streamline AI adoption by supporting both AI developers and consumers. It allows model developers to focus solely on model development and share models as transportable units (Templates), abstracting away complex production deployment concerns. KModels enables AI consumers to eliminate the need for a dedicated data scientist, as the templates encapsulate most data science considerations while providing business-oriented control. This paper presents the architecture of KModels and the key decisions that shape it. We outline KModels' main components as well as its interfaces. Furthermore, we explain how KModels is highly suited for on-premise deployment but can also be used in cloud environments. The efficacy of KModels is demonstrated through the successful deployment of three AI models within an existing Work Order Management system. These models operate in a client's data center and are trained on local data, without data scientist intervention. One model improved the accuracy of Failure Code specification for work orders from 46% to 83%, showcasing the substantial benefit of accessible and localized AI solutions.

AI落地企业应用本地部署模型模板

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。