揭示大模型推荐系统四大隐性偏见,关乎用户选择自由与平台可靠性。
LLM Biases
- 从注意力机制出发,分析模型生成推荐时的四种系统性偏见来源。
- 真实数据中微小频率差异可被放大,导致热门内容持续垄断。
- 适合平台管理者、算法伦理研究者关注,尤其关心长期用户影响的场景。
基于Transformer的智能体正被广泛部署于主流平台,辅助用户购物、观看和浏览内容。尽管表现优异,其可靠性仍存疑。本文从理论角度分析生成式推荐系统中,模型如何逐次生成用户下一次交互行为。聚焦注意力在历史行为上的分配机制,识别出四种偏见通道:(i) 位置偏见:强化近期历史的影响,提升响应速度但降低长期稳定性和多样性;(ii) 流行度放大:数据中微小的频率差异会被放大,引发马太效应与回音室现象;(iii) 隐含驱动偏见:当关键决策因素未被观测时,模型会过度集中于少数历史事件,造成误判;(iv) 合成数据偏见:用户越来越多地遵循AI建议,平台用模型生成的日志重新训练,导致输出逐渐集中,长尾选项最先消失。这些机制层面的风险在离线性能指标中难以察觉,却可能系统性扭曲用户暴露与选择。对管理者而言,应将其视为运营风险,持续监控集中度与漂移,而非仅依赖性能提升判断可靠性。
原文摘要 · Abstract (English)
Transformer-based agentic AI is rapidly being deployed on major platforms to help users shop, watch, and navigate content with less effort. While these systems can deliver impressive performance, a key concern is whether they may be less reliable than they appear. We ask a simple but fundamental question: whether the mechanisms that make transformer-based agents effective can also induce systematic biases or distortions? We study this question through a theoretical analysis of transformer-based generative recommenders, in which the next user interaction is generated sequentially from the user history. Focusing on how the model allocates attention across historical evidence, we identify four bias channels: (i) Positional bias: stronger positional encoding shifts influence toward recent history, improving responsiveness but potentially reducing stability and long-term diversity; (ii) Popularity amplification: small frequency differences in data can be magnified into disproportionate exposure, contributing to Matthew effects and echo chambers; (iii) Latent driver bias: when important drivers of user choices are not directly observed, the model can place overly concentrated weight on a small subset of past events, creating overconfident attributions. (iv) Synthetic data bias: when users increasingly follow AI suggestions and platforms retrain on model-shaped synthetic logs, outputs can concentrate over time, and long-tail alternatives can disappear first. Our analysis highlights mechanism-level reliability risks that may not be visible in offline performance metrics. The four bias channels indicate that large-scale deployment may systematically distort exposure and choice. For managers, the immediate implication is to treat these as operational risk factors and to monitor concentration and drift over time, rather than assuming that performance gains alone guarantee reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。