用户更愿为拟人化体验牺牲准确性,导致对ChatGPT过度信任。
Personality over Precision: Exploring the Influence of Human-Likeness on ChatGPT Use for Search
- 通过对比用户对ChatGPT与Google的感知,发现拟人化增强信任
- 173名参与者中,双用者(DUB)愿以事实性换个性对话体验
- 中年用户使用少却更信任,易受误导,需警惕信息风险
相较于传统搜索,对话式搜索界面(如ChatGPT)提供更互动、个性化和沉浸式的体验。然而,这类系统易引发过度信任问题,即用户即使面对错误回复仍盲目依赖。本文通过173名参与者的调查,研究了用户对信任度、拟人化(anthropomorphism)及设计偏好的感知差异。研究比较了同时使用ChatGPT与Google的双用者(DUB)与主要依赖Google的用户(DUG)。结果发现:DUB群体对ChatGPT信任度更高,认为其更具人类特征,并更愿意为个性化和对话流畅性牺牲事实准确性;而DUG群体虽信任度较低,但仍欣赏无广告和响应迅速等优点。进一步分析显示,中年用户虽使用频率较低,但信任度反而更高,可能更易受虚假信息影响。研究揭示了个人化与拟人化在对话式信息检索中的关键作用,以及用户为交互体验妥协真实性的潜在风险。
原文摘要 · Abstract (English)
Conversational search interfaces, like ChatGPT, offer an interactive, personalized, and engaging user experience compared to traditional search. On the downside, they are prone to cause overtrust issues where users rely on their responses even when they are incorrect. What aspects of the conversational interaction paradigm drive people to adopt it, and how it creates personalized experiences that lead to overtrust, is not clear. To understand the factors influencing the adoption of conversational interfaces, we conducted a survey with 173 participants. We examined user perceptions regarding trust, human-likeness (anthropomorphism), and design preferences between ChatGPT and Google. To better understand the overtrust phenomenon, we asked users about their willingness to trade off factuality for constructs like ease of use or human-likeness. Our analysis identified two distinct user groups: those who use both ChatGPT and Google daily (DUB), and those who primarily rely on Google (DUG). The DUB group exhibited higher trust in ChatGPT, perceiving it as more human-like, and expressed greater willingness to trade factual accuracy for enhanced personalization and conversational flow. Conversely, the DUG group showed lower trust toward ChatGPT but still appreciated aspects like ad-free experiences and responsive interactions. Demographic analysis further revealed nuanced patterns, with middle-aged adults using ChatGPT less frequently yet trusting it more, suggesting potential vulnerability to misinformation. Our findings contribute to understanding user segmentation, emphasizing the critical roles of personalization and human-likeness in conversational IR systems, and reveal important implications regarding users' willingness to compromise factual accuracy for more engaging interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。