提出两种无需知道污染类型的数据清洗方法,提升音乐分离模型性能。
Towards Blind Data Cleaning: A Case Study in Music Source Separation
- 用去学习技术识别并剔除贡献最小的训练样本
- 通过感知距离度量剔除与可信干净数据差异大的样本
- 不依赖具体噪声类型,适合各类数据清洗场景
音乐源分离的深度学习模型性能高度依赖训练数据质量。然而,数据常被难以察觉的伪影(如音频串扰、标签噪声)污染,且污染类型和程度通常未知,导致针对特定缺陷的清洗方法难适用。本文提出并评估两种无噪声假设的数据清洗方法:第一种通过去学习进行数据归因,筛选出对生成清晰输出贡献最小的样本;第二种利用弗雷歇音频距离,衡量样本与一小批可信干净参考集的感知差异,并移除不匹配项。在模拟真实世界噪声分布的污染数据集上,基于去学习的方法生成了清洁数据集及对应模型,其性能优于原始污染数据和用于清洗的小型干净参考集,缩小了约66.7%的性能差距(相比无污染基准)。与针对特定伪影的方法不同,本方法具备通用性,为高质量训练数据构建提供更普适的解决方案。
原文摘要 · Abstract (English)
The performance of deep learning models for music source separation heavily depends on training data quality. However, datasets are often corrupted by difficult-to-detect artifacts such as audio bleeding and label noise. Since the type and extent of contamination are typically unknown, cleaning methods targeting specific corruptions are often impractical. This paper proposes and evaluates two distinct, noise-agnostic data cleaning methods to address this challenge. The first approach uses data attribution via unlearning to identify and filter out training samples that contribute the least to producing clean outputs. The second leverages the Fréchet Audio Distance to measure and remove samples that are perceptually dissimilar to a small and trusted clean reference set. On a dataset contaminated with a simulated distribution of real-world noise, our unlearning-based methods produced a cleaned dataset and a corresponding model that outperforms both the original contaminated data and the small clean reference set used for cleaning. This result closes approximately 66.7\% of the performance gap between the contaminated baseline and a model trained on the same dataset without any contamination. Unlike methods tailored for specific artifacts, our noise-agnostic approaches offer a more generic and broadly applicable solution for curating high-quality training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。