arXiv:2502.19410cs.HCcs.AI2025-02被引 11

让大模型推荐解释在手表上更易读,通过结构化和动态展示提升体验。

Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices

  • 用结构化组件组织解释文本,提升阅读效率。
  • 结构化解释减少用户决策时间,降低认知负担。
  • 适合在智能手表等小屏设备上优化AI推荐展示的场景。

大型语言模型(LLMs)在作为个人AI助手推荐日常行为方面展现出巨大潜力,而可解释AI(XAI)技术则帮助用户理解推荐原因。当前个人助手常部署于智能手表等超小型设备,屏幕空间有限。然而,LLM生成的解释内容冗长,难以在这些设备上实现快速浏览。为此,本文探索了两个策略:1)在提示阶段使用特定上下文组件对解释文本进行空间结构化;2)根据置信度水平动态呈现解释内容。通过用户研究发现,结构化解释能显著减少用户采取行动的时间并降低认知负荷。始终开启的结构化解释提升了用户对AI推荐的接受度,但因细节不足,用户对其满意度低于非结构化解释。动态适应性呈现的效果不如始终开启的结构化方式。结合访谈反馈,研究提出设计建议:在小屏设备上需谨慎权衡解释内容与呈现时机。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown remarkable potential in recommending everyday actions as personal AI assistants, while Explainable AI (XAI) techniques are being increasingly utilized to help users understand why a recommendation is given. Personal AI assistants today are often located on ultra-small devices such as smartwatches, which have limited screen space. The verbosity of LLM-generated explanations, however, makes it challenging to deliver glanceable LLM explanations on such ultra-small devices. To address this, we explored 1) spatially structuring an LLM's explanation text using defined contextual components during prompting and 2) presenting temporally adaptive explanations to users based on confidence levels. We conducted a user study to understand how these approaches impacted user experiences when interacting with LLM recommendations and explanations on ultra-small devices. The results showed that structured explanations reduced users' time to action and cognitive load when reading an explanation. Always-on structured explanations increased users' acceptance of AI recommendations. However, users were less satisfied with structured explanations compared to unstructured ones due to their lack of sufficient, readable details. Additionally, adaptively presenting structured explanations was less effective at improving user perceptions of the AI compared to the always-on structured explanations. Together with users' interview feedback, the results led to design implications to be mindful of when personalizing the content and timing of LLM explanations that are displayed on ultra-small devices.

大模型可解释性小屏交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。