arXiv:2503.18497cs.LGcs.AI2025-03被引 1

用规则检测训练数据中的隐藏错误模式,确保模型不学坏。

Statistically Testing Training Data for Unwanted Error Patterns using Rule-Oriented Regression

  • 先定义规则再检验数据,发现潜在数据污染
  • 将模糊推理嵌入回归模型,兼具可解释性与统计验证能力
  • 适用于小数据集,适合数据清洗和可信训练

人工智能模型的性能受限于训练数据质量。数据中的偏见会传递至模型输出,但防范机制仍不成熟。当数据已存在时,如何检测其是否被篡改(即‘中毒’)以引入不良行为?这不同于提升模型精度或效率,我们提出一种方法来测试训练数据缺陷,建立后续训练的可信基础。与基于数据生成模糊规则不同,本方法在观察数据前先定义规则,从而发现隐藏错误模式。通过将模糊推理融入回归模型,结合模糊逻辑的可解释性与回归的统计诊断能力,且适用于小数据集,无需深度学习的大规模数据依赖。我们提供开源实现用于演示与实验。

原文摘要 · Abstract (English)

Artificial intelligence models trained from data can only be as good as the underlying data is. Biases in training data propagating through to the output of a machine learning model are a well-documented and well-understood phenomenon, but the machinery to prevent these undesired effects is much less developed. Efforts to ensure data is clean during collection, such as using bias-aware sampling, are most effective when the entity controlling data collection also trains the AI. In cases where the data is already available, how do we find out if the data was already manipulated, i.e., ``poisoned'', so that an undesired behavior would be trained into a machine learning model? This is a challenge fundamentally different to (just) improving approximation accuracy or efficiency, and we provide a method to test training data for flaws, to establish a trustworthy ground-truth for a subsequent training of machine learning models (of any kind). Unlike the well-studied problem of approximating data using fuzzy rules that are generated from the data, our method hinges on a prior definition of rules to happen before seeing the data to be tested. Therefore, the proposed method can also discover hidden error patterns, which may also have substantial influence. Our approach extends the abilities of conventional statistical testing by letting the ``test-condition'' be any Boolean condition to describe a pattern in the data, whose presence we wish to determine. The method puts fuzzy inference into a regression model, to get the best of the two: explainability from fuzzy logic with statistical properties and diagnostics from the regression, and finally also being applicable to ``small data'', hence not requiring large datasets as deep learning methods do. We provide an open source implementation for demonstration and experiments.

数据清洗规则检测小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。