arXiv:2507.09683cs.LGcs.GT2025-07被引 6

通过有向无环图实现多智能体信息聚合,让局部观测者联合学习出全局最优模型。

Networked Information Aggregation via Machine Learning

  • 各智能体基于父节点预测与自身观测特征,逐步构建预测模型。
  • 只要图深度足够且特征覆盖充分,最终可逼近全特征最优模型性能。
  • 适用于分布式学习中信息碎片化场景,尤其适合复杂网络结构设计。

研究嵌入在有向无环图(DAG)中的分布式学习问题:存在一个固定的特征/标签对分布,每个智能体仅能直接观测部分特征(不同智能体观测的特征集可能不同)。智能体按拓扑排序顺序依次学习,建立从观测到实值标签的映射模型。每个智能体不仅使用自身观测的特征,还引入其父节点的预测作为额外输入特征进行训练。我们探讨该过程能否实现‘信息聚合’——即是否存在某个智能体的学习模型误差,可与在假设类中拥有全部特征访问权限时所能达到的最佳模型相竞争。针对线性与一般假设类,给出了上下界分析。结果表明,图的‘深度’是关键参数:只要相关特征沿路径充分表示,足够长的路径上可实现信息聚合;而即使在任意大的图中,若深度不足(如星型结构),仍可能存在无法实现信息聚合的分布。理论结果通过全面实验验证。

原文摘要 · Abstract (English)

We study a distributed learning problem in which learning agents are embedded in a directed acyclic graph (DAG). There is a fixed and arbitrary distribution over feature/label pairs, and each agent or vertex in the graph is able to directly observe only a subset of the features -- potentially a different subset for every agent. The agents learn sequentially in some order consistent with a topological sort of the DAG, committing to a model mapping observations to predictions of the real-valued label. Each agent observes the predictions of their parents in the DAG, and trains their model using both the features of the instance that they directly observe, and the predictions of their parents as additional features. We ask when this process is sufficient to achieve \emph{information aggregation}, in the sense that some agent in the DAG is able to learn a model whose error is competitive with the best model that could have been learned (in some hypothesis class) with direct access to \emph{all} features, despite the fact that no single agent in the network has such access. We give upper and lower bounds for this problem for both linear and general hypothesis classes. Our results identify the \emph{depth} of the DAG as the key parameter: information aggregation can occur over sufficiently long paths in the DAG, assuming that all of the relevant features are well represented along the path, and there are distributions over which information aggregation cannot occur even in the linear case, and even in arbitrarily large DAGs that do not have sufficient depth (such as a hub-and-spokes topology in which the spoke vertices collectively see all the features). We complement our theoretical results with a comprehensive set of experiments.

分布式学习信息聚合有向无环图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。