研究记忆增强型AI招聘代理如何引入并放大偏见
From Personalization to Prejudice: Bias and Discrimination in Memory-Enhanced AI Agents for Recruitment
- 用记忆增强个人化机制模拟招聘AI行为
- 实验发现偏见在交互中系统性引入并被强化
- 警示需为记忆型AI设置防护机制，尤其在招聘场景
大型语言模型（LLMs）赋予AI代理理解、推理和交互的高级能力。引入记忆后，代理能实现跨交互连续性、从过往经验中学习，并随时间提升行为与响应的相关性，即记忆增强的个性化。尽管该机制带来明显优势，但也引入偏见风险。现有研究虽关注机器学习与LLM中的偏见，但对记忆增强个性化代理导致的偏见仍缺乏探索。本文以招聘为例，模拟记忆增强个性化代理的行为，研究其在各运行阶段是否引入并放大偏见。实验基于经过安全训练的LLMs发现，个性化过程系统性引入并强化了偏见，凸显了在记忆增强型基于LLM的AI代理中，亟需额外保护措施或代理护栏。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have empowered AI agents with advanced capabilities for understanding, reasoning, and interacting across diverse tasks. The addition of memory further enhances them by enabling continuity across interactions, learning from past experiences, and improving the relevance of actions and responses over time; termed as memory-enhanced personalization. Although such personalization through memory offers clear benefits, it also introduces risks of bias. While several previous studies have highlighted bias in ML and LLMs, bias due to memory-enhanced personalized agents is largely unexplored. Using recruitment as an example use case, we simulate the behavior of a memory-enhanced personalized agent, and study whether and how bias is introduced and amplified in and across various stages of operation. Our experiments on agents using safety-trained LLMs reveal that bias is systematically introduced and reinforced through personalization, emphasizing the need for additional protective measures or agent guardrails in memory-enhanced LLM-based AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。