arXiv:2608.20707cs.IR2026-08

用分层记忆和轨迹级强化学习,更真实地模拟用户网购行为。

Towards Faithful Simulation of Human Shopping Behavior

论文配图:Towards Faithful Simulation of Human Shopping Behavior
图 1 · 摘自论文原文
  • 分层记忆机制:工作记忆、情景记忆、偏好记忆协同处理长序列浏览信息。
  • 轨迹级奖励优化:整体评估购物路径,避免过度探索或被动行为。
  • 适合做电商仿真、离线评估和强化学习的模型,提升真实感。

模拟真实的用户购物行为对电商场景下的离线评估与强化学习至关重要。尽管近期基于大语言模型和视觉语言模型的模拟器取得进展,但复现真实浏览会话仍面临两大挑战:(i) 记忆难题:购物会话跨越数十页,现有智能体要么丢弃长程观察历史,丧失用户状态演变,要么简单拼接,挤占上下文窗口甚至降低模拟质量;(ii) 优化难题:当前用户模拟器通常通过模仿或逐步奖励监督,导致会话出现不合理的模式,如过度探索或过度被动,而逐步监督无法检测或纠正这些问题。为此,我们提出 RecVerse,一个基于图形界面的模拟智能体,通过截图感知页面并生成连贯的多轮轨迹。针对记忆挑战,RecVerse采用类认知的分层记忆结构:工作记忆用于短期聚焦,情景记忆记录会话内痕迹,偏好记忆存储高层次意图,并将记忆更新视为动作,使智能体自适应学习何时及何内容存入记忆。针对优化挑战,RecVerse采用轨迹级强化学习目标,对整个会话进行评分,使宏观动作类型分布与微观购物意图均与真实用户对齐。我们进一步发布了 USB(User Simulation Benchmark),一个用于多轮用户模拟的交互式电商图形界面轨迹数据集。实验表明,RecVerse 在行为保真度与意图一致性上显著优于现有基线。

原文摘要 · Abstract (English)

Simulating realistic user shopping behavior underpins offline evaluation and reinforcement learning in e-commerce scenarios. While recent LLM- and VLM-based simulators have made encouraging progress, reproducing a real browsing session remains difficult for two reasons. (i) Memory Challenge: a shopping session spans dozens of pages, yet existing agents either discard long-range observation histories, losing the evolving user state, or naively concatenate them, overwhelming the context window and even degrading simulation quality. (ii) Optimization Challenge: current user simulators are typically supervised to match each logged action via imitation or step-level rewards; the resulting sessions often display unrealistic patterns, such as over-exploration or excessive passivity, which per-step supervision can neither detect nor correct. To address the above challenges, we present RecVerse, a GUI-grounded simulation agent that perceives pages through screenshots and produces faithful multi-turn trajectories. For the memory challenge, RecVerse adopts a cognitive-inspired hierarchical memory: Working Memory for short-term focus, Episodic Memory for in-session traces, and Preference Memory for high-level intent, with memory updates treated as actions so that the agent adaptively learns when and what to memorize. For the optimization challenge, RecVerse is optimized with a trajectory-level RL objective that scores entire sessions, aligning both macro-level action-type distributions and micro-level shopping intent with real users. We further release USB (User Simulation Benchmark), an interactive e-commerce GUI trajectory dataset for multi-turn user simulation. Experiments show that RecVerse significantly outperforms existing baselines in both behavioral fidelity and intent consistency.

用户模拟电商强化学习分层记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。