首个面向个性化商品推荐的开放网页智能体评测基准。
AgenticShop: Benchmarking Agentic Product Curation for Personalized Web Shopping
- 构建真实购物场景与多样化用户画像,评估智能体在开放网页中的商品筛选能力。
- 现有智能体在复杂场景下表现不足,难以实现精准个性化推荐。
- 适合关注智能导购、用户行为建模的研究者与开发者参考。
电商的快速发展使网络购物平台成为用户探索数字市场的关键入口。然而,信息过载导致认知负担加重,购物体验碎片化。尽管智能体系统在自动化用户侧任务方面展现出潜力,但现有评测基准无法全面衡量其在开放网页环境中进行个性化商品筛选的能力。现有评估局限于简化场景,仅关注单一平台的简单查询,缺乏对探索性搜索的覆盖,且忽略个性化因素,难以判断智能体是否能适应真实购物中多样的用户偏好。为此,我们提出 AgenticShop,这是首个面向开放网页环境下个性化商品推荐的智能体评测基准。该基准包含真实购物场景、多样化的用户档案,以及基于检查清单的可验证个性化评估框架。通过大量实验,我们发现当前智能体系统仍远未达到实用水平,凸显了在现代网络环境中有效实现个性化商品推荐的迫切需求。
原文摘要 · Abstract (English)
The proliferation of e-commerce has made web shopping platforms key gateways for customers navigating the vast digital marketplace. Yet this rapid expansion has led to a noisy and fragmented information environment, increasing cognitive burden as shoppers explore and purchase products online. With promising potential to alleviate this challenge, agentic systems have garnered growing attention for automating user-side tasks in web shopping. Despite significant advancements, existing benchmarks fail to comprehensively evaluate how well agentic systems can curate products in open-web settings. Specifically, they have limited coverage of shopping scenarios, focusing only on simplified single-platform lookups rather than exploratory search. Moreover, they overlook personalization in evaluation, leaving unclear whether agents can adapt to diverse user preferences in realistic shopping contexts. To address this gap, we present AgenticShop, the first benchmark for evaluating agentic systems on personalized product curation in open-web environment. Crucially, our approach features realistic shopping scenarios, diverse user profiles, and a verifiable, checklist-driven personalization evaluation framework. Through extensive experiments, we demonstrate that current agentic systems remain largely insufficient, emphasizing the need for user-side systems that effectively curate tailored products across the modern web.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。