arXiv:2504.06075cs.LGcs.DS2025-04被引 13

两个观察不同特征的主体通过协作预测,无需共享数据即可提升准确率。

Collaborative Prediction: Tractable Information Aggregation via Agreement

  • 双方仅交换标签预测,不共享原始特征,实现高效信息聚合。
  • 通信量与数据维度无关,适用于高维或不可见特征空间场景。
  • 适用于人机协作、多模态学习,且可推广至高维决策问题。

我们提出高效的“协作协议”,使两个观察同一实例但不同特征的主体,通过交互达成比各自单独预测更准确的结果。双方只需迭代交换并更新标签预测,无需共享实际观测特征。协议是各自特征空间独立学习问题的有效约化,因此即使一方无法读取另一方的特征空间(如人机交互或多模态学习场景)仍可使用。通信开销与数据维度无关。在在线对抗设定下,我们证明了对联合特征空间上基准策略的后悔界,尽管任一方均未获知联合特征空间。在批量设定中,我们给出更简单的算法,假设存在固定但未知的数据分布。我们还将协议推广至高维输出空间的决策理论框架,此时双方仅传递“最优响应动作”。定理在计算与统计上均具可处理性,扩展了过去关于共享正确先验的贝叶斯主体间信息聚合的研究,属于以Aumann同意定理为范式的“共识”研究范畴。结果无需先验知识或其存在性,且计算高效。同时我们展示了如何将定理回溯至经典贝叶斯框架,从而为贝叶斯共识提供新的信息聚合定理。

原文摘要 · Abstract (English)

We give efficient "collaboration protocols" through which two parties, who observe different features about the same instances, can interact to arrive at predictions that are more accurate than either could have obtained on their own. The parties only need to iteratively share and update their own label predictions-without either party ever having to share the actual features that they observe. Our protocols are efficient reductions to the problem of learning on each party's feature space alone, and so can be used even in settings in which each party's feature space is illegible to the other-which arises in models of human/AI interaction and in multi-modal learning. The communication requirements of our protocols are independent of the dimensionality of the data. In an online adversarial setting we show how to give regret bounds on the predictions that the parties arrive at with respect to a class of benchmark policies defined on the joint feature space of the two parties, despite the fact that neither party has access to this joint feature space. We also give simpler algorithms for the same task in the batch setting in which we assume that there is a fixed but unknown data distribution. We generalize our protocols to a decision theoretic setting with high dimensional outcome spaces, where parties communicate only "best response actions." Our theorems give a computationally and statistically tractable generalization of past work on information aggregation amongst Bayesians who share a common and correct prior, as part of a literature studying "agreement" in the style of Aumann's agreement theorem. Our results require no knowledge of (or even the existence of) a prior distribution and are computationally efficient. Nevertheless we show how to lift our theorems back to this classical Bayesian setting, and in doing so, give new information aggregation theorems for Bayesian agreement.

协作预测信息聚合无共享通信贝叶斯共识

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。