arXiv:2606.11616cs.LGcs.IR2026-06KDD

通过影响向量识别数据错误类型,实现精准修复。

DeMix: Debugging Training Data with Mixed Data Error Types by Investigating Influence Vectors

论文配图:DeMix: Debugging Training Data with Mixed Data Error Types by Investigating Influence Vectors
图 1 · 摘自论文原文
  • 利用影响向量捕捉不同错误类型对模型行为的特异性模式。
  • 在11个任务中提升数据调试F1分数22.61%,修复后模型性能提升9.32%。
  • 适合需要精准定位数据问题的研究者和数据工程师。

高质量训练数据是机器学习成功的关键。然而,现实数据集常因数据处理流程中的系统性缺陷而混杂标签错误、特征错误和虚假关联等多种错误类型。有效调试需同时检测异常样本并识别其错误类型以实现针对性修复,但现有数据清洗与归因方法难以满足这一双重需求。本文提出DeMix,一种能同步诊断异常样本及其错误类型的新型框架。核心洞察是不同错误类型会在模型行为上产生独特模式。DeMix通过影响向量刻画每个训练样本对所有验证样本预测的影响,从而捕捉错误特异性模式。将数据调试建模为多标签分类问题,直接从影响向量预测错误类型,并引入基于干预的学习策略,引导分类器学习每种错误类型特有的不变判别依据,确保泛化能力。在表格数据预测、推荐系统及大模型对齐等11个任务上的实证评估表明,DeMix显著优于现有方法,数据调试F1得分提升22.61%,数据修复后任务模型性能提升9.32%。代码已开源:https://github.com/SJTU-DMTai/DeMix。

原文摘要 · Abstract (English)

High-quality training data is essential for the success of machine learning models. However, real-world datasets often contain mixed types of errors arising from systematic flaws in data preparation pipelines, including label errors, feature errors, and spurious correlations. Effective debugging of training data requires both detecting erroneous samples and identifying their specific error types to enable targeted repair, yet existing data cleaning and attribution methods fail to adequately address this dual requirement. In this paper, we propose DeMix, a novel framework that simultaneously diagnoses erroneous samples and their error types. Our key insight is that different error types produce distinct patterns on model behavior. DeMix captures such error-specific patterns by influence vectors that characterize how each training sample affects model predictions across all validation samples. We formulate training data debugging as a multi-label classification problem where a classifier is developed to predict error types directly from influence vectors. We further introduce an intervention-based learning strategy that guides the classifier to capture invariant rationales specific to each error type, ensuring the learned classifier generalizes effectively. Empirical evaluations on 11 tasks across tabular data prediction, recommendation systems, and LLM alignment demonstrate that DeMix significantly outperforms state-of-the-art approaches, achieving a 22.61% improvement in data debugging F1-score and a 9.32% gain in task model performance after data repair. Code is available at: https://github.com/SJTU-DMTai/DeMix.

数据清洗错误检测影响向量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。