用新词打破人机理解鸿沟,让机器更懂人类意图。
We Can't Understand AI Using our Existing Vocabulary
- 创造新词(neologisms)作为人机共通语言
- 通过长度/多样性新词实现对LLM输出的精准控制
- 适合研究人机交互与AI可解释性的人士阅读
本文主张,要真正理解人工智能,不能依赖现有的人类词汇体系。由于人类与机器的概念体系存在差异,解释性本质上是一个沟通问题:人类需能引用和控制机器概念,并向机器传递人类概念。我们提出通过构建新词(neologisms)来建立人机共享语言,以解决这一问题。成功的新词应具备适度抽象性——既不过于具体以保证复用性,也不过于笼统以确保信息精确。作为概念验证,我们展示了‘长度新词’可控制大模型输出长度,‘多样性新词’能引导生成更具变化性的响应。综上,仅靠现有词汇无法理解AI,通过发展新词可更好实现对机器的控制与理解。
原文摘要 · Abstract (English)
This position paper argues that, in order to understand AI, we cannot rely on our existing vocabulary of human words. Instead, we should strive to develop neologisms: new words that represent precise human concepts that we want to teach machines, or machine concepts that we need to learn. We start from the premise that humans and machines have differing concepts. This means interpretability can be framed as a communication problem: humans must be able to reference and control machine concepts, and communicate human concepts to machines. Creating a shared human-machine language through developing neologisms, we believe, could solve this communication problem. Successful neologisms achieve a useful amount of abstraction: not too detailed, so they're reusable in many contexts, and not too high-level, so they convey precise information. As a proof of concept, we demonstrate how a "length neologism" enables controlling LLM response length, while a "diversity neologism" allows sampling more variable responses. Taken together, we argue that we cannot understand AI using our existing vocabulary, and expanding it through neologisms creates opportunities for both controlling and understanding machines better.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。