arXiv:2511.00476cs.CL2025-11

LLM重构作者合作者列表时会放大学术界的不平等,高被引学者更易被记住。

Remembering Unequally: Global and Disciplinary Bias in LLM Reconstruction of Scholarly Coauthor Lists

  • 通过对比模型生成与真实文献数据,检验了LLM对合作者列表的重构能力。
  • 高被引学者在结果中被显著优先重现,但临床医学等学科表现较均衡。
  • 提醒研究者警惕模型记忆带来的偏见,尤其在跨区域、跨学科场景中。

大型语言模型(LLMs)正在重塑学术搜索与发现界面。尽管这些系统为知识导航提供了新可能,但也引发源于模型训练数据记忆的公平性与代表性偏见问题。随着LLMs越来越多用于回答关于研究人员和研究群体的问题,其准确重构合作者列表的能力成为一个重要却未被充分探讨的议题。本研究评估了DeepSeek R1、Llama 4 Scout和Mixtral 8x7B三个主流模型,通过比较其生成的合作者列表与文献引用数据。分析显示,模型记忆存在系统性偏差,高度被引学者更易被重现;但这一模式并非一致:临床医学等学科及非洲部分地区表现出更均衡的重构结果。这揭示了在学术发现场景中依赖LLM生成关系知识的风险与局限,并强调需对基于记忆的偏见进行审慎审计。

原文摘要 · Abstract (English)

Ongoing breakthroughs in large language models (LLMs) are reshaping scholarly search and discovery interfaces. While these systems offer new possibilities for navigating scientific knowledge, they also raise concerns about fairness and representational bias rooted in the models' memorized training data. As LLMs are increasingly used to answer queries about researchers and research communities, their ability to accurately reconstruct scholarly coauthor lists becomes an important but underexamined issue. In this study, we investigate how memorization in LLMs affects the reconstruction of coauthor lists and whether this process reflects existing inequalities across academic disciplines and world regions. We evaluate three prominent models, DeepSeek R1, Llama 4 Scout, and Mixtral 8x7B, by comparing their generated coauthor lists against bibliographic reference data. Our analysis reveals a systematic advantage for highly cited researchers, indicating that LLM memorization disproportionately favors already visible scholars. However, this pattern is not uniform: certain disciplines, such as Clinical Medicine, and some regions, including parts of Africa, exhibit more balanced reconstruction outcomes. These findings highlight both the risks and limitations of relying on LLM-generated relational knowledge in scholarly discovery contexts and emphasize the need for careful auditing of memorization-driven biases in LLM-based systems.

大模型偏见学术公平作者网络记忆偏差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。