arXiv:2509.08010cs.CYcs.AI2025-09被引 10

警惕大模型过度依赖,提出评估与缓解方法

Measuring and mitigating overreliance to build human-compatible AI

  • 从个体到社会层面分析大模型过度依赖的风险
  • 识别出认知偏差、系统设计等导致过度依赖的根源
  • 适合关注AI伦理与人机协同的研究者与从业者

大型语言模型(LLMs)作为协作型‘思维伙伴’,在医疗、个人建议等多个领域影响关键决策,但随之而来的过度依赖风险日益突出。本文系统梳理了过度依赖在个体与社会层面带来的危害,包括高风险错误、治理难题和认知能力退化。研究揭示了大模型特性、系统设计缺陷以及用户认知偏见共同加剧了这一问题。通过回顾历史测量方法,识别出三大关键缺口,并提出三条改进方向。最后,提出可实施的缓解策略,旨在确保大模型增强而非削弱人类能力。

原文摘要 · Abstract (English)

Large language models (LLMs) distinguish themselves from previous technologies by functioning as collaborative ``thought partners,'' capable of engaging more fluidly in natural language on a range of tasks. As LLMs increasingly influence consequential decisions across diverse domains from healthcare to personal advice, the risk of overreliance -- relying on LLMs beyond their capabilities -- grows. This paper argues that measuring and mitigating overreliance must become central to LLM research and deployment. First, we consolidate risks from overreliance at both the individual and societal levels, including high-stakes errors, governance challenges, and cognitive deskilling. Then, we explore LLM characteristics, system design features, and user cognitive biases that together raise serious and unique concerns about overreliance on LLMs in practice. We also examine historical approaches for measuring overreliance, identifying three important gaps and proposing three promising directions to improve measurement. Finally, we propose mitigation strategies that can be pursued to ensure LLMs augment rather than undermine human capabilities.

AI伦理人机协同大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。