人类指导能显著提升协作式代码生成效率,优于纯AI或混合模式。
Why Human Guidance Matters in Collaborative Vibe Coding
- 让人类主导提供高层指令,AI负责评估优化
- 737人参与实验,人类指令使任务成功率提升40%以上
- 适合关注人机协作的开发者与AI产品设计者
编码是人类将抽象想法转化为实际技术的核心方式。现代AI通过自然语言指令或“氛围编程”(vibe coding)使专家与非专家都能生成代码。然而,这种模式对生产力与协作的影响仍不明确。本文构建了受控实验框架,对比了人类主导、AI主导及混合组在20项实验中的表现,共涉及737名参与者。结果表明,人类提供的高层指令极具有效性,而AI生成的指令常导致性能崩溃;最优方案是人类主导提供指令,由AI负责评估与优化。尽管AI可在特定任务上快速调优,但本研究强调人类引导在塑造未来人机协同社会中的关键作用。
原文摘要 · Abstract (English)
Writing code has been one of the most transformative ways for human societies to translate abstract ideas into tangible technologies. Modern AI is changing this process by enabling experts and non-experts alike to generate code without actually writing it, instead using natural language instructions or "vibe coding". While increasingly popular, the impact of vibe coding on productivity and collaboration, and the role of humans in this process, remains unclear. Here, we introduce a controlled experimental framework for studying collaborative vibe coding and use it to compare human-led, AI-led, and hybrid groups. Across 20 experiments involving 737 human participants, we show that people provide uniquely effective high-level instructions for vibe coding, whereas AI-provided instructions often result in performance collapse. We further demonstrate that hybrid systems perform best when humans lead by providing instructions while evaluation is delegated to AI. Although AI systems can rapidly optimize performance for specific tasks, our work highlights the importance of human guidance in shaping future hybrid societies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。