LLM推荐城市时存在地理偏见,可能加剧贫富差距。
Unequal Opportunities: Examining the Bias in Geographical Recommendations by Large Language Models
- 分析大模型对美国城市在迁居、旅游、创业三领域的推荐一致性。
- 发现模型偏好高人口、高收入地区,导致弱势地区被持续低估。
- 适合关注AI公平性与社会影响的研究者与政策制定者。
大型语言模型(LLMs)已成为用户获取信息的热门工具,但其统计训练方式引发了对代表性不足话题的担忧,可能导致影响现实决策和机会分配的偏见。随着LLMs在聊天机器人、自动化助手或第三方应用中的广泛应用,这些偏见可能带来显著的经济、社会和文化后果。本研究考察了大模型在推荐美国城市与城镇时在迁居、旅游和创业三个领域中的偏差。重点关注两个核心问题:(i) LLMs输出响应的相似性如何;(ii) 这种相似性是否倾向于某些特征区域,从而引入系统性偏见。研究聚焦于响应的一致性及其对特定地点的过度或不足代表。结果表明,推荐中存在一致性的群体偏见,可能加剧“强者愈强”的效应,进一步扩大现有经济差距。
原文摘要 · Abstract (English)
Recent advancements in Large Language Models (LLMs) have made them a popular information-seeking tool among end users. However, the statistical training methods for LLMs have raised concerns about their representation of under-represented topics, potentially leading to biases that could influence real-world decisions and opportunities. These biases could have significant economic, social, and cultural impacts as LLMs become more prevalent, whether through direct interactions--such as when users engage with chatbots or automated assistants--or through their integration into third-party applications (as agents), where the models influence decision-making processes and functionalities behind the scenes. Our study examines the biases present in LLMs recommendations of U.S. cities and towns across three domains: relocation, tourism, and starting a business. We explore two key research questions: (i) How similar LLMs responses are, and (ii) How this similarity might favor areas with certain characteristics over others, introducing biases. We focus on the consistency of LLMs responses and their tendency to over-represent or under-represent specific locations. Our findings point to consistent demographic biases in these recommendations, which could perpetuate a ``rich-get-richer'' effect that widens existing economic disparities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。