arXiv:2506.09630cs.LG2025-06被引 2

LLM生成表格数据时会放大输入中的统计偏见,甚至被恶意注入偏见。

In-Context Bias Propagation in LLM-Based Tabular Data Generation

  • 通过上下文学习生成数据时,输入偏见会传递并扭曲合成数据分布。
  • 轻微的上下文偏见即可导致全局统计失真,恶意注入更可破坏分类公平性。
  • 预处理虽能缓解偏见,但模型对对抗性提示仍高度敏感,风险难根除。

大型语言模型(LLMs)通过上下文学习(ICL)生成合成表格数据,为数据稀缺场景下的数据增强提供了实用方案。尽管先前研究显示LLMs可通过扩充少数群体数据提升下游任务表现,但这些成果通常假设输入的上下文示例无偏且具有代表性。在现实场景中,数据常存在噪声和人口统计学偏差。本文系统研究了上下文示例中的统计偏见如何传播至合成表格数据分布,发现即使轻微的上下文偏见也会引发全局统计畸变。我们进一步设计了一种对抗场景,恶意贡献者可通过部分上下文示例向合成数据集中注入偏见,最终损害目标受保护群体的下游分类器公平性。最后,我们评估了基于预处理的缓解策略,结果表明此类干预虽可减弱差异,但LLMs对对抗性提示的固有敏感性仍是持续挑战。研究揭示了敏感领域中基于LLM的数据生成流程中的关键新漏洞。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly used for synthetic tabular data generation through in-context learning (ICL), offering a practical solution for data augmentation in data scarce scenarios. While prior work has shown the potential of LLMs to improve downstream task performance through augmenting underrepresented groups, these benefits often assume access to a subset of unbiased in-context examples, representative of the real dataset. In real-world settings, however, data is frequently noisy and demographically skewed. In this paper, we systematically study how statistical biases within in-context examples propagate to the distribution of synthetic tabular data, showing that even mild in-context biases lead to global statistical distortions. We further introduce an adversarial scenario where a malicious contributor can inject bias into the synthetic dataset via a subset of in-context examples, ultimately compromising the fairness of downstream classifiers for a targeted and protected subgroup. Finally, we evaluate mitigation strategies based on preprocessing in-context examples, demonstrating that while such interventions can attenuate disparity, the inherent sensitivity of LLMs to adversarial prompts remains a persistent challenge. Our findings highlight a critical new vulnerability in LLM-based data generation pipelines within sensitive domains.

大模型数据生成偏见传播公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。