提出人类-AI协作中非均匀监督原则,提升效率与质量。
Nonuniformity Principle in Human-AI Coworking

- 根据流程阶段动态安排人类监督,间隔逐步拉大。
- 实验证明该策略可减少重做和令牌消耗。
- 适合需要高质量输出的长流程AI任务使用。
随着生成式AI被用于自动化多步骤、高风险工作流,人类判断与参与仍是确保AI输出质量的关键。尽管理想情况下专家应定期监督AI,通过审查中间结果、反馈、修正并引导后续步骤,但人力时间与资源有限,导致监督与效率之间存在矛盾。本文基于观察发现,在长流程中适当的人类监督能提升用户满意度,并减少不必要的重做和令牌消耗。由此提出核心问题:如何最优安排人类监督节点?在合理假设下,推导出非均匀性原则——最优监督安排应具有逐渐增大的时间间隔。该原则在文献综述撰写和网站构建两类常见AI代理工作流中得到实证验证。
原文摘要 · Abstract (English)
As generative AI is increasingly applied to automate multi-step and high-stake workflows, human judgment and involvement remain essential for ensuring the quality of AI-generated outputs. In practice, while it is desirable for human experts to provide oversight on AI regularly, often by reviewing intermediate outputs, giving feedback, making corrections, and steering subsequent steps, such oversight is constrained by the time and resources that humans can afford. This creates a tension between the need for human oversight and AI's efficiency in delivering more output with less intervention. An important but underexplored question, then, is how to optimally engage humans in human-AI coworking. This work was originally motivated by our empirical observation that in long AI workflows, human oversight often improves user satisfaction while reducing unnecessary rework and token consumption. From there, we formulate the problem of where to place oversight stages in human-AI coworking. Under reasonable assumptions, we then develop the nonuniformity principle, which states that the optimal schedule places oversight stages with non-decreasing gaps along the workflow. We empirically validate this principle in two common AI agent workflows: writing literature reviews and constructing websites.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。