arXiv:2606.06694cs.LGcs.AI2026-06

LLM租房推荐存在种族偏差,用户身份影响房源推荐结果。

The Geography of Algorithmic Judgment: LLM Intermediaries, Place Identity, and Racial Steering in Housing Search

论文配图:The Geography of Algorithmic Judgment: LLM Intermediaries, Place Identity, and Racial Steering in Housing Search
图 1 · 摘自论文原文
  • 通过多轮提示测试,发现模型根据用户身份和偏好动态调整推荐。
  • 不同城市间偏差表现差异大,本地数据不可直接推广。
  • 适合关注算法公平性与城市治理的研究者参考。

大型语言模型(LLMs)正通过对话式界面介入租房搜索,中介城市空间信息获取与推荐。本文对七种开源与闭源模型在四个美国城市的租房推荐行为进行行为审计,采用三轮逐步增加生活方式偏好的提示条件,模拟公平住房配对测试方法。结果表明,种族引导是模型解释权下的涌现行为,而非固定属性。偏差源于用户身份、偏好表达与模型内化的地方空间逻辑之间的交互作用。偏好条件常增强或重构引导行为,说明相同偏好在不同种族用户下可能被不同解读。研究还发现,城市并非中立的评估单元,本地市场结果无法外推至其他城市。因此,在住房领域采用此类AI工具时,需结合本地与领域专业知识,以保障法律和制度上的公平住房承诺不被削弱。

原文摘要 · Abstract (English)

Large language models (LLMs) are rapidly assuming an intermediary role in housing search through the integration of listing platforms within conversational interfaces, mediating access to information, search, and recommendations within urban settings. We expand on prior work on racial steering in LLMs by conducting a behavioral audit of seven open-weight and closed-source LLMs across four U.S. cities, testing location recommendations across three iterative prompting conditions that progressively add lifestyle preference context and reflect fair housing paired-testing methodologies. We find that steering is an emergent behavior of the model's interpretive license rather than primarily a static property. Steering results from the interaction of a user's identity, preference articulation, and the spatial logic that a model has internalized about learned representations of place, preference, and opportunity in a given city, and how different types of users relate to it. While steering was present, it was not uniform in direction or magnitude across evaluated conditions. Preference-conditioned testing often increased or reconfigured the number of models that exhibited steering behaviors relative to baseline conditions, suggesting that LLMs may interpret what the same housing preference means differently depending on the racial identity of the user. Our findings also demonstrate that the city is not a neutral testing unit for LLM evaluation in place-based sectors, and results from one local market cannot be assumed to generalize to another. Local and domain expertise will be required in the housing sector to ensure that legal and institutional commitments to fair housing are not undermined while adopting AI tools that mediate spatial access.

算法公平租房推荐种族偏差LLM审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。