arXiv:2510.09968cs.SEcs.AI2025-10被引 1

实证分析8000+用户评论,验证MLOps对AI开发满意度的提升作用

Operationalizing AI: Empirical Evidence on MLOps Practices, User Satisfaction, and Organizational Context

  • 通过用户评论分析九类MLOps实践,识别关键影响因素
  • 七项实践与用户满意度显著正相关,体现实际价值
  • 小公司提及少但效果一致,说明MLOps普适性强

组织在应用和落地人工智能(AI)时常面临可扩展性、维护及跨团队协作等挑战。为此,机器学习运维(MLOps)作为一套将软件工程原则与机器学习生命周期管理需求结合的最佳实践应运而生。然而,关于这些实践是否以及如何支持用户开发与部署AI应用的实证证据仍有限。本研究分析了G2.com上超过8,000条AI开发平台用户评论,采用零样本分类方法评估用户对九项已确立的MLOps实践(包括持续集成与交付、工作流编排、可复现性、版本控制、协作、监控等)的评价。结果显示,九项中的七项与用户满意度显著正相关,表明有效实施MLOps能为AI开发带来切实收益。但组织背景亦具影响:来自小型企业的评论较少提及某些实践,说明组织情境会影响MLOps的普及程度与关注重点,尽管企业规模并未调节MLOps与满意度之间的关系。这表明,一旦实施,MLOps实践在各类组织中均被普遍认为具有价值。

原文摘要 · Abstract (English)

Organizational efforts to utilize and operationalize artificial intelligence (AI) are often accompanied by substantial challenges, including scalability, maintenance, and coordination across teams. In response, the concept of Machine Learning Operations (MLOps) has emerged as a set of best practices that integrate software engineering principles with the unique demands of managing the ML lifecycle. Yet, empirical evidence on whether and how these practices support users in developing and operationalizing AI applications remains limited. To address this gap, this study analyzes over 8,000 user reviews of AI development platforms from G2.com. Using zero-shot classification, we measure review sentiment toward nine established MLOps practices, including continuous integration and delivery (CI/CD), workflow orchestration, reproducibility, versioning, collaboration, and monitoring. Seven of the nine practices show a significant positive relationship with user satisfaction, suggesting that effective MLOps implementation contributes tangible value to AI development. However, organizational context also matters: reviewers from small firms discuss certain MLOps practices less frequently, suggesting that organizational context influences the prevalence and salience of MLOps, though firm size does not moderate the MLOps-satisfaction link. This indicates that once applied, MLOps practices are perceived as universally beneficial across organizational settings.

MLOps用户满意度实证研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。