arXiv:2605.16278cs.CYcs.AI2026-05被引 2

提出一套可落地的人工智能监督框架,解决谁来监督、怎么监督的难题。

Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems

论文配图:Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
图 1 · 摘自论文原文
  • 融合多学科视角,定义监督架构与流程
  • 提供可复用的监督设计模板,适配不同场景
  • 梳理领域关键挑战,指引后续研究方向

人工智能在高风险决策场景中的应用带来技术、安全与规范性挑战,唯有通过有效的人类监督才能缓解。然而当前对人类监督的理解缺乏统一基础:监督架构不清晰、角色职责不明、实施路径模糊。这使得研究者与实践者难以设计、部署和评估具备有效监督能力的系统。本文基于计算机科学、人机交互、心理学、哲学与法学等多学科视角,提出一套实用的人工智能系统有效监督框架,核心贡献包括:(1) 构建包含定义、架构与流程的基础框架;(2) 提出可应用于多元领域的监督架构与流程文档模板;(3) 梳理该新兴领域需关注的关键开放研究问题。

原文摘要 · Abstract (English)

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a common foundational understanding: oversight architectures are not well defined, the roles involved remain unclear, and implementation steps are opaque. Hence, researchers and practitioners struggle to determine how to design, implement, and evaluate systems that enable effective human oversight. This paper advances a practical framework for effective human oversight of AI systems, based on a cross-disciplinary perspective that draws on insights from computer science, human-computer interaction, psychology, philosophy, and law. The core contributions are: (1) a foundational framework, with a working definition, architecture and processes for effective human oversight of AI systems; (2) an initial template for documenting oversight architectures and processes, applied to diverse domains; and (3) a synthesis of open research challenges that need to be considered in the emerging field of effective human oversight of AI systems.

AI监督人机协作治理框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。