arXiv:2606.02776cs.CL2026-06被引 1

对话主题比用户背景更影响大模型建议,可能带来不公平结果。

Topics as Proxies for Sociodemographics: How Conversational Context Affects LLM Answers

论文配图:Topics as Proxies for Sociodemographics: How Conversational Context Affects LLM Answers
图 1 · 摘自论文原文
  • 用对话主题代替用户社会属性分析建议差异
  • 主题影响比社会背景更大,且效果不可预测
  • 警示高风险场景下需关注对话上下文影响

当大语言模型用于法律、医疗、金融等高风险场景时,仅一次对话历史就足以导致不同用户的输出结果差异。以往研究发现,这种差异会引发不同社会群体间的结果不公。本文表明,大模型其实难以从单次对话中推断用户社会属性,群体间差异实际非常微小。通过对比用户社会属性与对话中的(心理)语言特征,如话题、情绪、可读性等,发现对话主题对模型生成建议的预测力最强,能在一定程度上充当社会属性的代理变量,并常以不可预测的方式影响建议内容。这一现象令人担忧,凸显了未来需深入研究对话上下文在高风险场景中对大模型输出的影响。

原文摘要 · Abstract (English)

When large language models (LLMs) are used in high-stakes scenarios, such as legal, medical and financial advice, even a single conversation history is enough to drive differences in outcomes between users. Prior work has demonstrated that this results in outcome disparities between sociodemographic groups, with some groups receiving more advantageous outcomes than others. In this work, we demonstrate that LLMs actually struggle to infer user sociodemographics from a single conversation history and that although there are disparities between sociodemographic groups, they are minimal in magnitude. To investigate what is the main driver of disparities between users, we compare user sociodemographics to a range of (psycho)linguistic features of conversations, including conversation topic, emotions, and readability. We find that conversation topics are most predictive of LLM-generated advice within a conversational context, which, to some extent, function as proxies for sociodemographic groups and often affect advice in unpredictable ways. This is cause for concern and highlights the need for future research to better understand the effect of conversational context on LLM outputs in high-stakes scenarios.

大模型公平性对话上下文社会偏见

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。