研究多个相同模型聚合能否突破单模型能力局限,揭示三种扩展输出的机制。
Power and Limitations of Aggregation in Compound AI Systems
- 通过奖励函数设计控制多个模型输出,实现协同响应
- 发现三种机制可扩展可诱导输出集合,其中绑定集收缩最有效
- 适用于想突破提示工程与模型能力瓶颈的研究者
在构建复合型AI系统时,常通过查询多个相同模型并聚合结果来生成综合输出。鉴于模型的同质性,这引发疑问:聚合是否能获得比单个模型更丰富的输出?本文在简化的主-代理框架下研究聚合的效能与限制。该框架允许系统设计者通过奖励函数部分引导每个代理的输出,但仍受限于提示工程能力和模型自身性能。分析揭示了三种自然机制——可行性扩展、支持集扩展和绑定集收缩——使聚合能够扩大系统设计者可诱导的输出范围。我们证明,任何实现可诱导性扩展的聚合操作必须体现上述三种机制之一;而强化版本的机制则构成可诱导性扩展的充要条件。最后,我们在一个模拟参考生成任务中对LLMs进行了实证验证。整体而言,本研究为复合型AI系统何时能克服模型能力与提示工程限制提供了理论基础。
原文摘要 · Abstract (English)
When designing compound AI systems, a common approach is to query multiple copies of the same model and aggregate the responses to produce a synthesized output. Given the homogeneity of these models, this raises the question of whether aggregation unlocks access to a greater set of outputs than querying a single model. In this work, we investigate the power and limitations of aggregation within a stylized principal-agent framework. This framework models how the system designer can partially steer each agent's output through its reward function specification, but still faces limitations due to prompt engineering ability and model capabilities. Our analysis uncovers three natural mechanisms -- feasibility expansion, support expansion, and binding set contraction -- through which aggregation expands the set of outputs that are elicitable by the system designer. We prove that any aggregation operation must implement one of these mechanisms in order to be elicitability-expanding, and that strengthened versions of these mechanisms provide necessary and sufficient conditions that fully characterize elicitability-expansion. Finally, we provide an empirical illustration of our findings for LLMs deployed in a toy reference-generation task. Altogether, our results take a step towards characterizing when compound AI systems can overcome limitations in model capabilities and in prompt engineering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。