用大模型自动生成推荐系统模拟中的用户画像,提升真实性和泛化能力。
Task-Aware Automated User Profile Generation for Recommendation Simulation Using Large Language Models
- 基于大模型设计无监督画像生成框架,自动构建合理用户特征。
- 在3个数据集上使排名效果提升7%(nDCG@10),评分分布差异降低8%(JSD)。
- 生成画像对热门度和位置偏差不敏感,适配不同数据集与模型。
基于大语言模型的智能体模拟已成为满足现代推荐系统实时性与严谨性评估需求的前沿方法。典型框架包含画像、记忆和行为三模块,但现有研究多聚焦于记忆与行为模块,对关键的画像生成关注不足,导致模拟行为失真。同时,缺乏专用于推荐模拟的数据集,使得人工构建画像成为主流,严重限制了模拟框架的可扩展性与泛化能力。为此,本文提出自动化画像生成框架APG4RecSim,可在极少监督下生成真实、连贯且鲁棒的用户画像。在三个基准数据集上的实验表明,APG4RecSim在区分度、排序与评分任务中表现最佳,相较于现有基线,排序质量提升最高达7%(nDCG@10),评分分布差异降低8%(JSD)。此外,其生成画像对流行度与位置偏差具有强鲁棒性,在不同数据集与大模型间保持稳定性能。
原文摘要 · Abstract (English)
Large Language Model (LLM)-based agent simulation has emerged as a promising approach to meet the increasing demand for real-time and rigorous evaluation in modern recommender systems. A typical LLM-driven simulation framework comprises three essential components: the profile module, memory module, and action module. However, existing studies have primarily concentrated on enhancing the memory and action modules, with limited attention to profile generation, which plays a pivotal role in ensuring realistic agent behaviours and aligning simulated interactions with real user dynamics. Moreover, the scarcity of datasets specifically designed for recommendation simulations has led to heavy reliance on manually crafted profiles, significantly limiting the scalability and generalisability of simulation frameworks across different datasets. To address these challenges, this work proposes an Automated Profile Generation Framework for Recommendation Simulation, APG4RecSim, that constructs realistic, coherent, and robust user profiles with minimal supervision. Extensive experiments on three benchmark datasets demonstrate that APG4RecSim achieves the best overall performance on discrimination, ranking, and rating tasks, improving ranking quality by up to 7% in nDCG@10 and reducing rating distribution divergence by 8% in JSD compared to existing profile-generation baselines. Beyond overall performance gains, our results show that profiles generated by APG4RecSim are resilient to popularity- and position-induced biases and maintain stable performance across datasets and different LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。