arXiv:2604.09698cs.IRcs.AI2026-04ACL被引 7

为沉浸式对话推荐设计了标签选择评估新方法。

Evaluating Scene-based In-Situ Item Labeling for Immersive Conversational Recommendation

论文配图:Evaluating Scene-based In-Situ Item Labeling for Immersive Conversational Recommendation
图 1 · 摘自论文原文
  • 按用户意图与主动需求分类信息,构建评估框架。
  • 三种场景下模型表现均存在冗余与遗漏问题。
  • 适合做XR推荐系统研究者参考。

扩展现实(XR)的普及正推动对话推荐系统(CRS)向视觉沉浸式体验发展。我们提出沉浸式对话推荐系统(ICRS),在用户场景化视觉环境中直接突出推荐项,并添加原位标签。尽管推荐算法研究广泛,但如何选择并评估应呈现的沉浸式标签仍属开放问题。为此,我们首次将信息需求分为显性意图满足与主动信息需求两类,并据此构建新的标签选择评估指标。我们在时尚、电影推荐和零售购物三个场景中,对基于信息检索(IR)、大语言模型(LLM)和视觉语言模型(VLM)的方法进行了基准测试。结果揭示现有方法存在三方面局限:(1)未能利用场景特异性模态(如时尚中的视觉线索、零售中的元数据);(2)呈现大量可直观推断的冗余信息;(3)仅凭对话无法有效预判用户主动信息需求。本工作不仅提供了ICRS中原位标签选择的新评估范式,也指出了未来研究的关键挑战。

原文摘要 · Abstract (English)

The growing ubiquity of Extended Reality (XR) is driving Conversational Recommendation Systems (CRS) toward visually immersive experiences. We formalize this paradigm as Immersive CRS (ICRS), where recommended items are highlighted directly in the user's scene-based visual environment and augmented with in-situ labels. While item recommendation has been widely studied, the problem of how to select and evaluate which information to present as immersive labels remains an open problem. To this end, we introduce a principled categorization of information needs into explicit intent satisfaction and proactive information needs and use these to define novel evaluation metrics for item label selection. We benchmark IR-, LLM-, and VLM-based methods across three datasets and ICRS scenarios: fashion, movie recommendation, and retail shopping. Our evaluation reveals three important limitations of existing methods: (1) they fail to leverage scenario-specific information modalities (e.g., visual cues for fashion, meta-data for retail), (2) they present redundant information that is visually inferable, and (3) they poorly anticipate users' proactive information needs from explicit dialogue alone. In summary, this work provides both a novel evaluation paradigm for in-situ item labeling in ICRS and highlights key challenges for future work.

沉浸式推荐XR对话系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。