arXiv:2507.13835stat.MLcs.LG2025-07被引 2

提出无需假设分布的检测方法,确保数据共享时的质量可信。

Conformal Data Contamination Tests for Trading or Sharing of Data

  • 基于校准理论设计两样本检验,识别污染数据
  • 在任意污染水平下保持有效性,支持错误率控制
  • 适合需保障数据质量的协作学习场景

许多机器学习任务中可用的优质数据受限于数据拥有者的本地资源。通过与外部数据代理交易或共享,可扩展高质量数据集。然而,数据买家在购买前需要质量保证,因为外部数据可能被污染或与自身学习任务无关。以往工作主要依赖不同代理数据的分布假设,将质量检查置于代价高昂的事后数据估值步骤。本文提出一种无需分布假设、具备污染感知能力的数据共享框架,能够识别对模型个性化最有价值的外部数据代理。为此,引入基于校准异常检测严格理论基础的新颖两样本检验方法,判断某代理数据是否超过污染阈值。所提测试称为校准数据污染检测,在任意污染水平下均有效,并可通过Benjamini-Hochberg程序实现假阳性发现率控制。在多种协作学习场景下的实证评估表明该方法具有鲁棒性和有效性。总体而言,校准数据污染检测是一种通用的数据聚合程序,可提供统计上严谨的质量保障。

原文摘要 · Abstract (English)

The amount of quality data in many machine learning tasks is limited to what is available locally to data owners. The set of quality data can be expanded through trading or sharing with external data agents. However, data buyers need quality guarantees before purchasing, as external data may be contaminated or irrelevant to their specific learning task. Previous works primarily rely on distributional assumptions about data from different agents, relegating quality checks to post-hoc steps involving costly data valuation procedures. We propose a distribution-free, contamination-aware data-sharing framework that identifies external data agents whose data is most valuable for model personalization. To achieve this, we introduce novel two-sample testing procedures, grounded in rigorous theoretical foundations for conformal outlier detection, to determine whether an agent's data exceeds a contamination threshold. The proposed tests, termed conformal data contamination tests, remain valid under arbitrary contamination levels while enabling false discovery rate control via the Benjamini-Hochberg procedure. Empirical evaluations across diverse collaborative learning scenarios demonstrate the robustness and effectiveness of our approach. Overall, the conformal data contamination test distinguishes itself as a generic procedure for aggregating data with statistically rigorous quality guarantees.

数据质量校准协作学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。