优化提示词设计,提升大模型在不平衡数据上的补全质量
Does Prompt Design Impact Quality of Data Imputation by LLMs?
- 用结构化分组提示词+去除无关信息,精准引导大模型补全数据
- 小规模数据集上提示词体积减少,补全效果反而更好
- 适合关注大模型生成数据质量与提示工程的研究者
生成真实感强的合成表格数据是机器学习中的关键挑战,尤其当数据存在类别不平衡问题时更为复杂。本文提出一种新的面向标记的数据补全方法,利用大语言模型的上下文学习能力,通过结构化的分组式CSV提示技术,并剔除输入提示中的无关信息。我们在两个类别不平衡的二分类数据集上测试该方法,采用基于分类的评估指标衡量补全效果。实验结果表明,相较于基线提示,本方法显著减少了输入提示大小,同时在小规模数据集上保持甚至提升了补全质量。研究贡献在于:1)揭示了在利用大模型生成合成数据时提示设计的重要性;2)针对存在缺失数据的类别不平衡数据集,提供了在计算资源受限下的实用解决方案。
原文摘要 · Abstract (English)
Generating realistic synthetic tabular data presents a critical challenge in machine learning. It adds another layer of complexity when this data contain class imbalance problems. This paper presents a novel token-aware data imputation method that leverages the in-context learning capabilities of large language models. This is achieved through the combination of a structured group-wise CSV-style prompting technique and the elimination of irrelevant contextual information in the input prompt. We test this approach with two class-imbalanced binary classification datasets and evaluate the effectiveness of imputation using classification-based evaluation metrics. The experimental results demonstrate that our approach significantly reduces the input prompt size while maintaining or improving imputation quality compared to our baseline prompt, especially for datasets that are of relatively smaller in size. The contributions of this presented work is two-fold -- 1) it sheds light on the importance of prompt design when leveraging LLMs for synthetic data generation and 2) it addresses a critical gap in LLM-based data imputation for class-imbalanced datasets with missing data by providing a practical solution within computational constraints. We hope that our work will foster further research and discussions about leveraging the incredible potential of LLMs and prompt engineering techniques for synthetic data generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。