比较人与机器的泛化机制,推动更契合人类认知的AI对齐。
Aligning Generalisation Between Humans and Machines
- 从认知科学和AI视角对比泛化概念与方法
- 揭示人机在抽象、推理与规则学习上的差异
- 为人类-AI协作提供认知支持的对齐基础
近期人工智能(包括生成式方法)的发展使技术能够辅助科学发现与决策,但也可能破坏民主制度并针对个人。负责任地使用AI,并使其参与人机协作团队,日益凸显出对齐的重要性——即让AI系统的行为符合人类偏好。一个关键但常被忽视的方面是人类与机器在泛化方式上的不同。在认知科学中,人类泛化通常涉及抽象与概念学习;而在人工智能中,泛化涵盖机器学习中的跨领域泛化、符号AI中的规则推理,以及神经符号AI中的抽象。本文结合人工智能与认知科学的洞见,从泛化的概念、方法与评估三个维度,梳理了两者间的共性与差异,并探讨其在人机协作对齐中的作用。这提出了跨学科挑战,需在人工智能与认知科学领域共同解决,以建立有效且认知支持的人机协作对齐基础。
原文摘要 · Abstract (English)
Recent advances in AI -- including generative approaches -- have resulted in technology that can support humans in scientific discovery and forming decisions, but may also disrupt democracies and target individuals. The responsible use of AI and its participation in human-AI teams increasingly shows the need for AI alignment, that is, to make AI systems act according to our preferences. A crucial yet often overlooked aspect of these interactions is the different ways in which humans and machines generalise. In cognitive science, human generalisation commonly involves abstraction and concept learning. In contrast, AI generalisation encompasses out-of-domain generalisation in machine learning, rule-based reasoning in symbolic AI, and abstraction in neurosymbolic AI. In this perspective paper, we combine insights from AI and cognitive science to identify key commonalities and differences across three dimensions: notions of, methods for, and evaluation of generalisation. We map the different conceptualisations of generalisation in AI and cognitive science along these three dimensions and consider their role for alignment in human-AI teaming. This results in interdisciplinary challenges across AI and cognitive science that must be tackled to provide a foundation for effective and cognitively supported alignment in human-AI teaming scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。