arXiv:2607.27553cs.AIcs.CL2026-07被引 15

AI生成的产品创意质量更高,但多样性不足,可借多模型协同和提示工程弥补。

AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas

  • 用多模型协作与提示工程提升AI创意多样性。
  • AI创意平均质量更高,是人类创意的7倍更可能进入前10%。
  • 适合创新管理者参考,优化AI辅助产品设计流程。

本研究探讨大型语言模型(LLMs)为价格低于50美元的大学生生成新产品创意的效果。第一项研究显示,基于购买意愿评估,LLM生成的创意平均质量高于人类创意,且进入前10%的可能性高出7倍。第二项研究排除了模型说服力作为解释因素。第三至四项研究发现,AI生成的创意在个体层面新颖性较低,在集合层面多样性不足。第五项研究分析已有文献,确认所有基于LLM的创意研究均存在较低的创意多样性,表明该现象具有普遍性。第六至七项研究测试缓解策略:较新版本模型生成更多样化创意,但仍不及人类;通过跨厂商整合、链式思维提示、引入异质角色或约束条件、以及使用探索性代理,可使多样性接近人类水平。第八项研究证明,利用AI近乎零边际成本的优势,持续扩大创意数量能稳步提升创意空间覆盖率,接近人类水平。研究最后提出创新管理者可操作的建议。

原文摘要 · Abstract (English)

This research examines how well large language models, or LLMs, generate new product ideas for college students priced under $50. Across a series of studies, we identify key strengths and weaknesses of using LLMs for product innovation. Our first study shows that LLM-generated product ideas have higher average quality than human ideas, based on purchase intent, and are 7 times more likely to rank in the top 10%. Our second study shows that this AI-induced creativity boost is not explained by the LLM's more persuasive pitching skills. Our third and fourth studies identify a weakness of using LLMs for brainstorming: AI-generated ideas are less novel at the idea level and less diverse at the set level. In our fifth study, we analyze prior LLM-based creativity studies and find consistently lower idea diversity across all of them, demonstrating the generalizability of these findings. Our sixth and seventh studies investigate techniques to mitigate this diversity loss. We compare LLMs from different vendors and versions and find that more recent models generate more diverse ideas, though they still fall short of human-level diversity. We also demonstrate techniques that increase idea diversity almost to the level of human idea generation: pooling ideas across vendors; prompt engineering, including Chain-of-Thought prompting and injecting heterogeneous personas or constraints; and creative agents that broadly explore the solution landscape to restore diversity. Finally, in our eighth study, we show that exploiting the near-zero marginal cost of AI idea generation by scaling the number of ideas steadily improves coverage of the idea space, approaching human-level coverage. We conclude by presenting actionable recommendations for innovation managers who want to identify better new product ideas with the help of LLMs.

产品创新大模型创意多样性提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。