arXiv:2501.16125cs.IR2025-01被引 15

用大模型生成推荐数据,让合成样本更贴近真实分布。

SampleLLM: Optimizing Tabular Data Synthesis in Recommendations

  • 两阶段框架:先用思维链生成初稿,再用特征重要性精修关系。
  • 在三个推荐数据集上超越现有方法,合成数据分布更准。
  • 适合需要高质量合成数据的推荐系统研究与工业部署。

表格数据合成在机器学习中至关重要,但现有通用方法主要基于统计或深度学习模型,高度依赖数据且常无法满足推荐系统需求。其根源在于难以捕捉复杂分布、理解稀疏数据中的特征关系,以及缺乏语义关联理解。最近,大语言模型(LLMs)通过少样本学习和语义理解展现出生成合成数据的潜力,但常因与目标数据分布不一致导致样本不一致且多样性不足。为解决这些问题并提升推荐任务中的表格数据合成质量,本文提出一种名为SampleLLM的两阶段框架,通过确保更好的分布对齐来优化生成效果。第一阶段使用带思维链提示和多样化示例的LLM,在输入样本有限时生成贴近目标分布的数据。第二阶段采用基于特征重要性的改进采样方法,优化合成数据中的特征关系,缓解LLM引入的分布偏差。在三个推荐数据集、两个通用数据集及线上部署上的实验表明,SampleLLM显著优于现有方法,且在更广泛的表格数据场景中具有应用前景。

原文摘要 · Abstract (English)

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from their difficulty in capturing complex distributions and understanding feature relationships from sparse and limited data, along with their inability to grasp semantic feature relations. Recently, Large Language Models (LLMs) have shown potential in generating synthetic data samples through few-shot learning and semantic understanding. However, they often suffer from inconsistent distribution and lack of diversity due to their inherent distribution disparity with the target dataset. To address these challenges and enhance tabular data synthesis for recommendation tasks, we propose a novel two-stage framework named SampleLLM to improve the quality of LLM-based tabular data synthesis for recommendations by ensuring better distribution alignment. In the first stage, SampleLLM employs LLMs with Chain-of-Thought prompts and diverse exemplars to generate data that closely aligns with the target dataset distribution, even when input samples are limited. The second stage uses an advanced feature attribution-based importance sampling method to refine feature relationships within the synthesized data, reducing any distribution biases introduced by the LLM. Experimental results on three recommendation datasets, two general datasets, and online deployment illustrate that SampleLLM significantly surpasses existing methods for recommendation tasks and holds promise for a broader range of tabular data scenarios.

推荐系统数据合成大模型表格生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。