arXiv:2607.03346cs.CLcs.AI2026-07

用模型合并估算多任务数据贡献,高效且无需共享数据。

Efficient Decentralized Multi-task Dataset Valuation via Model Merging

论文配图:Efficient Decentralized Multi-task Dataset Valuation via Model Merging
图 1 · 摘自论文原文
  • 通过模型参数组合推断各数据集贡献,避免重训练和数据共享。
  • 在多任务场景下实现高效估值,计算成本低于传统方法。
  • 适合隐私敏感的去中心化数据市场,支持安全协作评估。

准确高效的数据库估值对实现公平透明的数据市场至关重要,尤其当多个贡献者为多任务模型提供数据时。现有方法大多局限于单任务场景,忽略了买家需在多个下游任务中优化性能的情况。传统估值方法如基于Shapley或重训练的方法计算开销大,且不适用于无可信中心协调者、隐私约束严格的去中心化环境。我们提出DMVM(基于模型合并的去中心化多任务估值),通过任务算术直接从模型组合中推断数据集贡献,无需重训练或共享原始数据。该方法在参数空间中量化不同数据集训练的模型组合,从而推导出各数据集在多任务上的边际效用。此框架具有可扩展性、计算高效,并与多任务泛化行为显式对齐。为支持去中心化部署,引入安全聚合协议,实现协作估值的同时不暴露个体模型参数或私有数据。我们还提供了理论误差界以刻画DMVM的近似质量,并在计算机视觉和自然语言处理任务上进行了全面实验验证。

原文摘要 · Abstract (English)

Accurate and efficient dataset valuation is essential for enabling fair and transparent data marketplaces, especially when multiple contributors provide data for training multi-task models. Most existing valuation methods, however, are limited to single-task settings, overlooking scenarios where a buyer aims to optimize performance across multiple downstream tasks. Moreover, traditional valuation approaches, such as Shapley-based or retraining-based methods, are computationally expensive and poorly suited for decentralized environments without a trusted central coordinator and with strict privacy constraints. We propose DMVM (Decentralized Multi-task Valuation via Model Merging), a novel framework that bypasses retraining and data sharing by leveraging task arithmetic to infer dataset contributions directly from model combinations. Instead of retraining or sharing raw data, DMVM quantifies how models trained on different datasets combine in parameter space to infer each dataset's marginal utility across multiple tasks. This formulation yields a valuation process that is scalable, computationally efficient, and explicitly aligned with multi-task generalization behavior. To support decentralized deployment, we introduce a secure aggregation protocol that enables collaborative valuation without revealing individual model parameters or private data. We also provide theoretical error bounds characterizing the approximation quality of DMVM and validate our framework through comprehensive experiments on computer vision and natural language processing tasks.

数据估值多任务学习去中心化模型合并

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。