构建可复用的AI工作流仓库,提升智能代理的可靠性与安全性
Engineering Robustness into Personal Agents with the AI Workflow Store

- 提出AI工作流仓库概念,将工程化流程融入代理生成过程
- 强调严谨测试与部署可显著增强系统稳定性与抗攻击能力
- 适合关注高风险场景下AI系统安全性的研究者与开发者
当前主流AI代理采用即时生成与执行的范式,响应用户指令在数秒至数分钟内完成规划与行动。本文指出该范式跳过了软件工程中迭代设计、严格测试、对抗评估、分阶段部署等关键流程,导致系统缺乏可靠性与安全性。若仅依赖快速合成,代理可能只是未经验证的原型,难以适用于高风险场景。为此,论文主张将严谨的软件工程实践融入代理循环,构建生产级、可加固、确定性约束的工作流。这一过程虽需更多计算与时间,但可通过跨用户社区复用实现成本摊销。我们构想一个AI工作流仓库,提供经验证的、可复用的工作流,使代理调用时具备远超临时工具链的可靠性和安全性。文中还剖析了该愿景面临的研究挑战,核心在于灵活性与鲁棒性之间的张力,需突破‘即时生成’范式才能有效应对。
原文摘要 · Abstract (English)
The dominant paradigm for AI agents is an "on-the-fly" loop in which agents synthesize plans and execute actions within seconds or minutes in response to user prompts. We argue that this paradigm short-circuits disciplined software engineering (SE) processes -- iterative design, rigorous testing, adversarial evaluation, staged deployment, and more -- that have delivered the (relatively) reliable and secure systems we use today. By focusing on rapid, real-time synthesis, are AI agents effectively delivering users improvised prototypes rather than systems fit for high-stakes scenarios in which users may unwittingly apply them? This paper argues for the need to integrate rigorous SE processes into the agentic loop to produce production-grade, hardened, and deterministically-constrained agent *workflows* that substantially outperform the potentially brittle and vulnerable results of on-the-fly synthesis. Doing so may require extra compute and time, and if so, we must amortize the cost of rigor through reuse across a broad user community. We envision an *AI Workflow Store* that consists of hardened and reusable workflows that agents can invoke with far greater reliability and security than improvised tool chains. We outline the research challenges of this vision, which stem from a broader flexibility-robustness tension that we argue requires moving beyond the ``on-the-fly'' paradigm to navigate effectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。