研究发现搜索策略影响新闻真伪判断,好查询能提升辨识力。
Query Smarter, Trust Better? Exploring Search Behaviours for Verifying News Accuracy
- 用不同方式生成搜索词,影响查证效果
- 多轮搜索和高质量结果显著降低对假新闻的信任
- 界面设计引导用户细看结果,有助改进查询
尽管人们常认为搜索信息有助于识别虚假新闻,但近期研究指出,若用户直接使用新闻原文词汇生成查询,反而可能强化对误导性内容的信念。本研究通过混合方法探究不同查询生成策略对新闻验证的影响:首先分析现有数据,揭示搜索行为如何影响对假新闻的信任;其次利用大语言模型模拟不同查询方式对搜索结果质量的影响;最后开展用户实验,测试界面中的“Boost”干预是否能引导用户采用更有效的查询策略。结果显示,成功搜索通常涉及多次查询并获得高质量结果;源自新闻不同部分的查询产生不同质量的结果,初始弱查询在参考完整搜索结果页面后可得到改善。尽管“Boost”干预作用有限,但研究表明,鼓励用户深入审阅搜索结果的界面设计,有助于提升查询质量。该研究强调查询策略在信息评估中的关键作用,并提出界面设计可作为对抗错误信息的一环。
原文摘要 · Abstract (English)
While it is often assumed that searching for information to evaluate misinformation will help identify false claims, recent work suggests that search behaviours can instead reinforce belief in misleading news, particularly when users generate queries using vocabulary from the source articles. Our research explores how different query generation strategies affect news verification and whether the way people search influences the accuracy of their information evaluation. A mixed-methods approach was used, consisting of three parts: (1) an analysis of existing data to understand how search behaviour influences trust in fake news, (2) a simulation of query generation strategies using a Large Language Model (LLM) to assess the impact of different query formulations on search result quality, and (3) a user study to examine how 'Boost' interventions in interface design can guide users to adopt more effective query strategies. The results show that search behaviour significantly affects trust in news, with successful searches involving multiple queries and yielding higher-quality results. Queries inspired by different parts of a news article produced search results of varying quality, and weak initial queries improved when reformulated using full SERP information. Although 'Boost' interventions had limited impact, the study suggests that interface design encouraging users to thoroughly review search results can enhance query formulation. This study highlights the importance of query strategies in evaluating news and proposes that interface design can play a key role in promoting more effective search practices, serving as one component of a broader set of interventions to combat misinformation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。