用大模型生成用户行为叙事,实现更连贯的个性化理解。
UserGPT Technical Report

- 用生成式方法将复杂行为日志转为连贯叙事,避免碎片化。
- 在模拟数据上实现标签预测0.7325、摘要生成0.7528准确率。
- 适合做个性化推荐与智能代理交互的研究者参考。
从大规模数字痕迹中实现个性化用户理解仍是核心挑战。传统用户画像依赖判别模型和人工特征工程,常产生零散且逻辑不一致的画像,对长尾行为泛化能力差。本文研究生成式范式,利用大语言模型(LLMs)将冗长嘈杂的行为历史归纳为连贯叙事,捕捉用户演变的细微特征。实验表明,即使强模型在复杂隐含推理上仍受限。为此提出UserGPT框架,通过属性生成与摘要生成双路径提升基于LLM的个性理解。为缓解真实行为数据稀缺,构建用户行为仿真引擎,生成真实且复杂的用户轨迹。引入数据中心语义化模块,将异构行为日志转化为结构化语义输入,降低噪声与稀疏性。在此基础上设计课程驱动的后训练策略,结合多阶段监督微调(SFT)与双过滤组相对策略优化(DF-GRPO),强化对长期行为历史的推理能力。同时构建HPR-Bench基准,基于仿真数据评估整体人格推理。在该基准上,UserGPT在标签预测上达到Avg@10 0.7325,摘要生成准确率Acc_{Ex}达0.7528,行为记录压缩高达97.9%的同时保留关键信息。结果证明UserGPT在整体人格推理与个性化用户-代理交互中的有效性。
原文摘要 · Abstract (English)
Personalized user understanding from large-scale digital traces remains a fundamental challenge. Traditional user profiling methods rely on discriminative models and manual feature engineering to predict discrete attributes, often producing fragmented and logically inconsistent profiles that generalize poorly to long-tail behaviors. In this work, we study a generative paradigm in which large language models (LLMs) summarize long and noisy behavioral histories into coherent narratives that capture nuanced user evolution. Our experiments show that even strong LLMs remain limited in complex and implicit personalization reasoning. We propose UserGPT, a framework for improving LLM-based persona understanding through both attribute generation and summary generation. To address the scarcity of real-world behavioral data, we develop a User Behavior Simulation Engine that produces realistic and complex user trajectories. We further introduce a Data-Centric Semantization module that transforms heterogeneous behavioral logs into structured and semantically coherent inputs, reducing noise and sparsity. On top of this pipeline, we design a curriculum-driven post-training strategy that combines multi-stage Supervised Fine-Tuning (SFT) with Dual-Filter Group Relative Policy Optimization (DF-GRPO) to strengthen reasoning over long behavioral histories. We also construct HPR-Bench, a benchmark for holistic persona reasoning derived from simulated data. On HPR-Bench, UserGPT achieves an Avg@10 score of 0.7325 on tag prediction and an $Acc_{Ex}$ score of 0.7528 on summary generation, while compressing behavioral records by up to 97.9% with critical information preserved. These results demonstrate the effectiveness of UserGPT for holistic persona reasoning and personalized user-agent interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。