arXiv:2607.26893cs.IR2026-07

让广告模拟器学会思考,提升推荐系统评估的准确性。

Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising

论文配图:Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising
图 1 · 摘自论文原文
  • 通过跨领域历史构建决策上下文,生成用户思考过程与行为
  • 在腾讯真实数据上,同时提升行为预测与思维质量,准确率超基线12.3%
  • 适合需要高保真评估的推荐系统研发人员使用

基于大模型的用户模拟器在推荐与广告系统的离线评估中展现出潜力。然而,现有模拟器通常仅从单一领域交互历史推断偏好,主要优化点击等可观测行为,难以全面捕捉用户真实偏好,且易产生模型捷径,降低模拟的保真度与诊断价值。为此,我们提出DASH——一种决策感知型用户模拟器,能从异构跨领域历史中联合生成思考轨迹并预测行为动作。DASH首先通过上下文工程将多源历史折叠为决策相关上下文,并优化提示以促进有效推理;训练时,利用强模型提炼的思维轨迹作为SFT数据,并设计基于评分标准的奖励模型,从形式、内容与逻辑三方面评估思考过程,结合行为奖励进行强化学习。在涵盖五个异构内容领域的腾讯真实广告数据集上,实验验证了DASH在有效性、效率、保真度与诊断价值上的显著优势。

原文摘要 · Abstract (English)

Recent advances in LLM-based user simulation have shown promise for offline evaluation of recommendation and advertising systems. However, existing simulators typically infer user preferences from single-domain interaction histories and are primarily optimized to reproduce observable actions such as clicks. Consequently, they capture only a partial view of user preferences, while action-only prediction easily induces model shortcuts and limits both the fidelity and diagnostic value of simulation. To address these challenges, we propose DASH, a decision-aware user simulator that jointly generates thinking traces and predicts behavioral actions from heterogeneous cross-domain histories. DASH first introduces a Context Engineering stage that folds heterogeneous cross-domain histories into decision-relevant context, together with prompt optimization for effective reasoning over the folded context. To train a user simulator, DASH distills thinking trajectories from strong LLMs as SFT data, and further tailors a rubric-based reward model that evaluates thinking traces along form, content, and logic for RL training. Combined with the action reward, these signals jointly improve action prediction and thinking quality. Extensive experiments on real-world Tencent advertising data spanning five heterogeneous content domains demonstrate the effectiveness, efficiency, fidelity, and diagnostic value of DASH.

用户模拟大模型广告系统决策推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。