研究大公司后台员工如何用生成式AI，发现资深员工更擅长且不同部门差异大。
Sophistication in GenAI Use: Field Evidence from a Large Firm
- 分析4000名员工8个月71万条提示，考察使用AI的成熟度。
- 资深员工和战略、创新等职能使用更高级，体现专业能力与AI互补。
- 培训后未见长期提升，说明高级用法难改变，适合管理者参考。
我们研究了一家大型企业后台员工在生成式AI（genAI）使用上的成熟度差异。基于专属数据，观察了2025年八个月内近4,000名员工在15个职能领域的713,564条员工提示及其对应的大型语言模型响应。主要发现有三：第一，资深员工表现出更高程度的genAI使用成熟度，符合领域专长与genAI能力互补的规律；第二，成熟度在不同职能间差异显著，最高出现在战略、数字创新和项目管理三个以公司级战略举措和组织变革为核心的职能；第三，未观察到使用成熟度随时间提升，也未发现正式AI培训带来持久改进，表明高级用法难以改变。本研究为管理者提供了可衡量的genAI使用成熟度指标，并为未来研究提供基础。
原文摘要 · Abstract (English)
We study how sophistication in generative AI (genAI) use varies among the back-office workforce of a large firm. Using proprietary data, we observe 713,564 employee prompts and their corresponding large language model responses from nearly 4,000 back-office employees across 15 functional areas over eight months in 2025. We document three main findings. First, senior employees exhibit more sophisticated genAI use, consistent with domain expertise complementing genAI capabilities. Second, sophistication varies considerably across functions and is highest in Strategy, Digital Innovation, and Project Management, three groups that share a focus on firmwide strategic initiatives and organizational change. Third, we observe neither improvements in sophistication over time nor lasting improvements following formal AI training, suggesting that sophisticated use can be difficult to change. Together, our study provides measures of and insights into sophisticated genAI use that managers can use to improve outcomes and that researchers can use in future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。