arXiv:2507.03223cs.AIcs.LG2025-07被引 1

用智能体循环优化可读的AI指令,让大模型更好懂也更好用。

SI-Agent: An Agentic Framework for Feedback-Driven Generation and Tuning of Human-Readable System Instructions for Large Language Models

  • 三智能体协作:教员、执行者与反馈者闭环迭代生成指令
  • 生成的指令既提升任务表现又保持人类可读性,优于传统方法
  • 适合想自定义大模型行为的研究者和开发者

系统指令(System Instructions, SIs)对引导大语言模型(LLMs)至关重要,但人工编写耗时且效果常不理想。现有自动化方法多生成不可读的“软提示”,牺牲可解释性。本文提出SI-Agent,一种基于智能体的框架,通过反馈驱动循环自动生成并迭代优化人类可读的SIs。该框架包含三个协同智能体:教员智能体、目标LLM(指令执行者)和反馈/奖励智能体,用于评估任务性能与指令可读性。通过迭代过程,反馈指导教员采用基于LLM编辑或进化算法等方式优化指令。实验验证了SI-Agent在任务性能、指令可读性与效率上的有效性,结果表明其在性能与可解释性间取得良好平衡,优于基线方法。潜在应用包括降低大模型定制门槛、提升模型透明度。也承认计算成本与反馈可靠性等挑战。

原文摘要 · Abstract (English)

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft prompts," sacrificing interpretability. This paper introduces SI-Agent, a novel agentic framework designed to automatically generate and iteratively refine human-readable SIs through a feedback-driven loop. SI-Agent employs three collaborating agents: an Instructor Agent, an Instruction Follower Agent (target LLM), and a Feedback/Reward Agent evaluating task performance and optionally SI readability. The framework utilizes iterative cycles where feedback guides the Instructor's refinement strategy (e.g., LLM-based editing, evolutionary algorithms). We detail the framework's architecture, agent roles, the iterative refinement process, and contrast it with existing methods. We present experimental results validating SI-Agent's effectiveness, focusing on metrics for task performance, SI readability, and efficiency. Our findings indicate that SI-Agent generates effective, readable SIs, offering a favorable trade-off between performance and interpretability compared to baselines. Potential implications include democratizing LLM customization and enhancing model transparency. Challenges related to computational cost and feedback reliability are acknowledged.

大模型指令智能体框架可读性优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。