检测下游模型是否用了大模型生成的合成数据,提升使用透明度。
Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications
- 不依赖训练细节,用三类无监督方法识别合成数据痕迹。
- 在文本分类等任务中,准确率最高达88%,仅需200个查询。
- 适合关注数据伦理与合规性的研究人员和监管者。
大型语言模型(LLMs)推动了高质量、低成本合成数据的生成,广泛用于下游模型开发与统计分析。然而,合成数据可能放大社会偏见与虚假信息(幻觉)。本文首次提出合成数据痕迹审计,旨在识别训练或衍生自合成数据的分类器、生成器或可视化图表,以降低下游应用风险。提出三种无需披露训练细节的审计方法:基于指标、调参与分类的方法。在三个文本分类任务、两个摘要任务及两个数据可视化任务中评估,覆盖三种训练场景。结果表明所有方法均有效:黑盒指标审计在分类器与生成器上分别达到平均0.868±0.071与0.880±0.052的准确率,仅需200个随机查询即可实现。研究有助于提升模型透明性与合规性,推动合成数据的负责任使用。
原文摘要 · Abstract (English)
Large language models (LLMs) have facilitated the generation of high-quality, cost-effective synthetic data for developing downstream models and conducting statistical analyses in various domains. However, the increased reliance on synthetic data may pose potential negative impacts. Numerous studies have demonstrated that LLM-generated synthetic data can perpetuate and even amplify societal biases and stereotypes, and produce erroneous outputs known as ``hallucinations'' that deviate from factual knowledge. In this paper, we aim to audit artifacts, such as classifiers, generators, or statistical plots, to identify those trained on or derived from synthetic data and raise user awareness, thereby reducing unexpected consequences and risks in downstream applications. To this end, we take the first step to introduce synthetic artifact auditing to assess whether a given artifact is derived from LLM-generated synthetic data. We then propose an auditing framework with three methods including metric-based auditing, tuning-based auditing, and classification-based auditing. These methods operate without requiring the artifact owner to disclose proprietary training details. We evaluate our auditing framework on three text classification tasks, two text summarization tasks, and two data visualization tasks across three training scenarios. Our evaluation demonstrates the effectiveness of all proposed auditing methods across all these tasks. For instance, black-box metric-based auditing can achieve an average accuracy of $0.868 \pm 0.071$ for auditing classifiers and $0.880 \pm 0.052$ for auditing generators using only 200 random queries across three scenarios. We hope our research will enhance model transparency and regulatory compliance, ensuring the ethical and responsible use of synthetic data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。