合成数据让真实标准失效,却能提升模型性能。
Synthetic Data and the Shifting Ground of Truth
- 用生成模型制造数据,无需对应真实世界
- 加入噪声和荒谬数据反而提升模型泛化能力
- 适合研究数据真实性与模型训练关系的学者
合成数据在隐私保护、数据生成或便捷获取准真实数据方面日益普及,但其不指向外部真实特征,打破了传统对真实性的依赖。尽管缺乏表征性,合成数据仍被广泛用于训练AI模型和构建真值库。研究发现,非真实数据不仅可接受,甚至常带来优于真实数据的模型表现:可补偿已知偏差、防止过拟合并增强对异常值的鲁棒性。向训练集注入噪声和明显荒谬的数据反而有益。这颠覆了‘垃圾进,垃圾出’的常识假设。更深层地,真值本身也变成生成模型的产物,不再关联真实世界观测,形成自我指涉的真值体系。本文探讨在无稳定表征基础下,机器学习研究者如何建立真值体系,并反思从表征到拟像或象征式数据概念的转变。
原文摘要 · Abstract (English)
The emergence of synthetic data for privacy protection, training data generation, or simply convenient access to quasi-realistic data in any shape or volume complicates the concept of ground truth. Synthetic data mimic real-world observations, but do not refer to external features. This lack of a representational relationship, however, not prevent researchers from using synthetic data as training data for AI models and ground truth repositories. It is claimed that the lack of data realism is not merely an acceptable tradeoff, but often leads to better model performance than realistic data: compensate for known biases, prevent overfitting and support generalization, and make the models more robust in dealing with unexpected outliers. Indeed, injecting noisy and outright implausible data into training sets can be beneficial for the model. This greatly complicates usual assumptions based on which representational accuracy determines data fidelity (garbage in - garbage out). Furthermore, ground truth becomes a self-referential affair, in which the labels used as a ground truth repository are themselves synthetic products of a generative model and as such not connected to real-world observations. My paper examines how ML researchers and practitioners bootstrap ground truth under such paradoxical circumstances without relying on the stable ground of representation and real-world reference. It will also reflect on the broader implications of a shift from a representational to what could be described as a mimetic or iconic concept of data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。