多智能体协作优化知识,高效又私密。
ADKO: Agentic Decentralized Knowledge Optimization

- 各智能体用私有高斯过程建模,仅交换压缩后的知识令牌。
- 理论证明累计遗憾可分解为四部分,且在特定条件下可实现次线性增长。
- 适合需要隐私保护的分布式优化场景,如神经架构搜索与科学发现。
我们提出协同黑箱优化框架ADKO,支持自主智能体间的高效、隐私保护、异构目标处理及低通信开销协作。每个智能体维护基于本地数据的私有高斯过程(GP)代理模型,并仅通过知识令牌——紧凑的有损摘要(包含方向信号、优势分数及可选语言模型洞察)——进行通信,不共享原始数据或模型参数。ADKO统一了GP-上置信界(GP-UCB)、并行贝叶斯优化、去中心化学习与语言模型引导发现。我们首次对双重信息损失进行形式化分析:令牌压缩损失(通过互信息量化保真度)与语言模型近似误差(分解为偏差与随机噪声)。主要结果表明累计遗憾可分解为GP误差、LM偏差、LM噪声和压缩损失,并给出了实现次线性遗憾的充要条件。此外,我们提出保真度感知的令牌剪枝策略,在内存预算下保留高信息量令牌。在神经架构搜索与科学发现任务上的实验验证了理论有效性,性能持续优于强基线。
原文摘要 · Abstract (English)
We present Agentic Decentralized Knowledge Optimization (ADKO), a framework for collaborative black-box optimization across autonomous agents that achieves sample efficiency, privacy preservation, heterogeneous-objective handling, and communication efficiency. Each agent maintains a private Gaussian Process (GP) surrogate trained on local data and communicates only through knowledge tokens-compact, lossy summaries containing directional signals, advantage scores, and optional language-model (LM) insights-without sharing raw data or model parameters. ADKO unifies GP-Upper Confidence Bound (GP-UCB), parallel Bayesian optimization, decentralized learning, and LM-guided discovery. We provide the first formal analysis of dual information loss: token compression, quantified via mutual-information-based fidelity, and LM approximation error, decomposed into bias and stochastic noise. Our main result shows cumulative regret decomposes into GP error, LM bias, LM noise, and compression loss, with necessary and sufficient conditions for sublinear regret. We also propose fidelity-aware token pruning to preserve high-information tokens under memory budget. Experiments on neural architecture search and scientific discovery validate the theory and show consistent improvements over strong baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。