arXiv:2505.18893cs.CYcs.AI2025-05被引 25

AI评估需从实验室走向真实场景,关注长期社会影响。

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

  • 构建包含真实情境的动态评估体系,超越静态测试。
  • 揭示AI在教育、医疗等领域的长期行为与社会效应。
  • 适合政策制定者与伦理研究者参考,推动负责任AI落地。

传统AI评估聚焦技术栈内部,难以捕捉教育、金融、医疗、就业等真实场景中的人类与社会因素。现有评估可识别短期输出准确性或内容偏见,但对AI使用带来的长期后果——如用户行为改变、社会文化经济影响、劳动力结构转型及潜在风险的深远影响——关注不足。本文主张,必须突破孤立的静态单轮测试,发展能反映真实使用情境的评估范式,通过具备上下文感知能力的数据与方法,实现对AI次级效应的可解释性分析与决策支持,并提出新评估生态系统的必要要求。

原文摘要 · Abstract (English)

Conventional AI evaluation approaches concentrated within the AI stack exhibit systemic limitations for exploring, navigating and resolving the human and societal factors that play out in real world deployment such as in education, finance, healthcare, and employment sectors. AI capability evaluations can capture detail about first-order effects, such as whether immediate system outputs are accurate, or contain toxic, biased or stereotypical content, but AI's second-order effects, i.e. any long-term outcomes and consequences that may result from AI use in the real world, have become a significant area of interest as the technology becomes embedded in our daily lives. These secondary effects can include shifts in user behavior, societal, cultural and economic ramifications, workforce transformations, and long-term downstream impacts that may result from a broad and growing set of risks. This position paper argues that measuring the indirect and secondary effects of AI will require expansion beyond static, single-turn approaches conducted in silico to include testing paradigms that can capture what actually materializes when people use AI technology in context. Specifically, we describe the need for data and methods that can facilitate contextual awareness and enable downstream interpretation and decision making about AI's secondary effects, and recommend requirements for a new ecosystem.

AI评估社会影响真实世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。