让无法访问内部结构的私有AI模型协同工作,实现预测精度飞跃。
Online Federation For Mixtures of Proprietary Agents with Black-Box Encoders
- 设计去中心化联邦算法,通过反馈机制协调各私有AI
- 在真实与合成时间序列上提升预测精度数个数量级
- 适用于无法获取模型参数的工业级生成式AI协作场景
多数工业级生成式AI和特征编码器为专有系统,仅提供黑盒访问:用户可观测输出,但无法获知其内部参数与架构。这在构建专家混合型集成模型时尤为受限,因无法优化各专有AI的内部参数。本问题天然适合非竞争博弈视角,各专有AI(代理)因互不知晓内部结构而自然形成竞争关系,用户则作为中央规划者协调这些相互竞争的AI。我们证明了在线设置下存在唯一纳什均衡,并通过建立时间序列与各(专有)AI生成序列间的反馈机制,以闭式形式计算该均衡。所提方案实现为去中心化联邦学习算法,各代理在其本地设备上独立优化自身结构,无需向其他方披露内部信息。针对预训练模型如Transformer、随机特征模型及回声状态网络,我们推导出优化表达式。该‘专有联邦学习’算法在多种真实与合成时间序列基准上验证,相较现有自然基线实现数量级的预测精度提升——这在很大程度上归因于该问题仍鲜被探索。
原文摘要 · Abstract (English)
Most industry-standard generative AIs and feature encoders are proprietary, offering only black-box access: their outputs are observable, but their internal parameters and architectures remain hidden from the end-user. This black-box access is especially limiting when constructing mixture-of-expert type ensemble models since the user cannot optimize each proprietary AI's internal parameters. Our problem naturally lends itself to a non-competitive game-theoretic lens where each proprietary AI (agent) is inherently competing against the other AI agents, with this competition arising naturally due to their obliviousness of the AI's to their internal structure. In contrast, the user acts as a central planner trying to synchronize the ensemble of competing AIs. We show the existence of the unique Nash equilibrium in the online setting, which we even compute in closed-form by eliciting a feedback mechanism between any given time series and the sequence generated by each (proprietary) AI agent. Our solution is implemented as a decentralized, federated-learning algorithm in which each agent optimizes their structure locally on their machine without ever releasing any internal structure to the others. We obtain refined expressions for pre-trained models such as transformers, random feature models, and echo-state networks. Our ``proprietary federated learning'' algorithm is implemented on a range of real-world and synthetic time-series benchmarks. It achieves orders-of-magnitude improvements in predictive accuracy over natural benchmarks, of which there are surprisingly few due to this natural problem still being largely unexplored.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。