提出无需共同目标的去中心化数据协作新范式,突破传统联邦学习局限。
Task-Agnostic Federation over Decentralized Data: Research Landscape and Visions
- 以数据为中心的无任务依赖协作,摆脱学习驱动的资源消耗
- 构建三类技术路径:协同数据扩展、精炼与融合,实现跨主体数据互用
- 适合关注隐私保护下异构数据合作的研究者与实践者
日益严格的隐私法规导致数据分散在各个独立的数据孤岛中。尽管基于联邦学习的协作模式可在保护隐私的前提下实现去中心化数据合作,但其固有的公平性差、成本高、可复现性弱等问题,源于以学习为中心的设计,严重制约了参与方的合作方式。为此,本文探索从资源密集型学习转向无任务依赖协作的可能性,尤其在参与者无共同目标时。我们提出新的研究场景——任务无关联邦(Task-Agnostic Federation, TAF),并分析其核心技术构成。这些技术以数据为中心,不依赖具体学习任务,可独立运行。本文首先描述TAF的系统架构与问题设定,提出三向发展路线,将近期研究归纳为三个方向:协同数据扩展、协同数据精炼与集体数据调和。进一步指出若干亟待关注的挑战与开放问题。通过本研究,旨在为自主个体在多样化动机下超越学习框架实现去中心化数据协作提供新视角。
原文摘要 · Abstract (English)
Increasing legislation and regulations on private and proprietary information results in scattered data sources also known as the "data islands". Although Federated Learning-based paradigms can enable privacy-preserving collaboration over decentralized data, they have inherent deficiencies in fairness, costs and reproducibility because of being learning-centric, which greatly limits the way how participants cooperate with each other. In light of this, we investigate the possibilities to shift from resource-intensive learning to task-agnostic collaboration especially when the participants have no interest in a common goal. We term this new scenario as Task-Agnostic Federation (TAF), and investigate several branches of research that serve as the technical building blocks. These techniques directly or indirectly embrace data-centric approaches that can operate independently of any learning task. In this article, we first describe the system architecture and problem setting for TAF. Then, we present a three-way roadmap and categorize recent studies in three directions: collaborative data expansion, collaborative data refinement, and collective data harmonization in the federation. Further, we highlight several challenges and open questions that deserve more attention from the community. With our investigation, we intend to offer new insights about how autonomic parties with varied motivation can cooperate over decentralized data beyond learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。