提出代理中心投影框架,揭示提示技术与多智能体系统间的深层联系。
Agent-Centric Projection of Prompting Techniques and Implications for Synthetic Training Data for Large Language Models
- 以线性/非线性上下文划分提示技术,构建代理中心分析框架。
- 发现非线性提示结果可预测多智能体系统表现,二者存在等价关系。
- 为生成合成训练数据提供新思路,适合提示工程与多智能体研究者。
近年来,大型语言模型(LLMs)的提示技术与多智能体系统发展迅速,但缺乏对提示技术进行分类比较的框架,也难以理解其与多智能体系统的关联。本文提出线性上下文(单一连续交互序列)与非线性上下文(分支或多路径)的概念,建立代理中心的提示技术投影框架,揭示提示策略与多智能体系统间的深层联系。基于此框架,提出三项猜想:(1)非线性提示技术的结果可预测等效多智能体系统的输出;(2)多智能体架构可通过单模型提示技术模拟等效交互模式实现复现;(3)上述等价性为生成合成训练数据提供了新方法。该视角推动提示与多智能体领域研究的交叉融合,为未来大模型的设计与训练提供新方向。
原文摘要 · Abstract (English)
Recent advances in prompting techniques and multi-agent systems for Large Language Models (LLMs) have produced increasingly complex approaches. However, we lack a framework for characterizing and comparing prompting techniques or understanding their relationship to multi-agent LLM systems. This position paper introduces and explains the concepts of linear contexts (a single, continuous sequence of interactions) and non-linear contexts (branching or multi-path) in LLM systems. These concepts enable the development of an agent-centric projection of prompting techniques, a framework that can reveal deep connections between prompting strategies and multi-agent systems. We propose three conjectures based on this framework: (1) results from non-linear prompting techniques can predict outcomes in equivalent multi-agent systems, (2) multi-agent system architectures can be replicated through single-LLM prompting techniques that simulate equivalent interaction patterns, and (3) these equivalences suggest novel approaches for generating synthetic training data. We argue that this perspective enables systematic cross-pollination of research findings between prompting and multi-agent domains, while providing new directions for improving both the design and training of future LLM systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。