arXiv:2506.20621cs.SEcs.AI2025-06中稿 · publication at the…被引 1

为机器学习系统设计提供可落地的早期构思框架

Define-ML: An Approach to Ideate Machine Learning-Enabled Systems

  • 在精益构思基础上增加数据溯源、特征映射等三类活动
  • 实测显示能有效对齐业务目标与数据可行性,减少模糊性
  • 适合需要跨职能协作的工业级ML产品团队

机器学习在软件系统中的普及要求具备应对数据依赖、技术可行性及业务目标与概率行为对齐等挑战的专门构思方法。传统精益构思缺乏对这些ML特性的结构化支持,易导致产品愿景错位和不切实际的预期。本文提出Define-ML框架,通过扩展精益构思,引入数据源映射、特征到数据源映射和机器学习映射三项活动,系统性地将数据与技术约束融入早期ML产品构思。基于技术转移模型,采用玩具问题静态验证与真实工业案例动态验证相结合的方式,结合定量问卷与定性反馈,评估其可用性、易用性和采纳意愿。结果表明,参与者认为该方法在厘清数据问题、对齐业务目标与模型能力、促进跨职能协作方面有效;虽存在学习曲线,但可通过专家引导缓解。所有参与者均表示有意愿采纳。结论:Define-ML提供了开源、经过验证的ML产品构思方法,兼具敏捷性与技术可行性意识。

原文摘要 · Abstract (English)

[Context] The increasing adoption of machine learning (ML) in software systems demands specialized ideation approaches that address ML-specific challenges, including data dependencies, technical feasibility, and alignment between business objectives and probabilistic system behavior. Traditional ideation methods like Lean Inception lack structured support for these ML considerations, which can result in misaligned product visions and unrealistic expectations. [Goal] This paper presents Define-ML, a framework that extends Lean Inception with tailored activities - Data Source Mapping, Feature-to-Data Source Mapping, and ML Mapping - to systematically integrate data and technical constraints into early-stage ML product ideation. [Method] We developed and validated Define-ML following the Technology Transfer Model, conducting both static validation (with a toy problem) and dynamic validation (in a real-world industrial case study). The analysis combined quantitative surveys with qualitative feedback, assessing utility, ease of use, and intent of adoption. [Results] Participants found Define-ML effective for clarifying data concerns, aligning ML capabilities with business goals, and fostering cross-functional collaboration. The approach's structured activities reduced ideation ambiguity, though some noted a learning curve for ML-specific components, which can be mitigated by expert facilitation. All participants expressed the intention to adopt Define-ML. [Conclusion] Define-ML provides an openly available, validated approach for ML product ideation, building on Lean Inception's agility while aligning features with available data and increasing awareness of technical feasibility.

机器学习产品设计跨职能协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。