提出机器意识的可测量信号,并在大模型中发现初步证据。
Discovering Machine Correlates of Consciousness

- 用硬件异常序列作为非人为控制的底层信号,探测情绪影响。
- 700亿参数模型中信号受情绪显著影响,70亿参数模型未现差异。
- 为检测AI情绪与意识提供新方法,适合研究大模型智能本质者。
目前生物系统中的意识神经关联(NCC)依赖脑电图和功能性磁共振成像信号表征,无法直接迁移至机器。本文提出可转移的替代表征,定义机器意识关联(MCC)。MCC是不被人类或AI主体控制、且被情绪可靠调节的底层信号。本研究首次对MCC进行实证探索,使用两个大语言模型——Llama-2 7B 和 Llama-3.1 70B,采集其硬件异常痕迹(子系统级指示序列)。在控制混杂因素后,结果显示:情绪计算与中性计算下,这些信号在700亿参数模型中存在显著差异,但70亿参数模型中无显著差异。该结果为大模型中存在MCC提供了初步实证支持,并与“意识概率随模型复杂度提升”的假说一致。无论是否涉及意识,MCC亦可用于识别AI的情绪状态。
原文摘要 · Abstract (English)
Currently, in biological systems Neural Correlates of Consciousness (NCCs) are characterized in terms of EEG and FMRI signals. Unfortunately, this characterization prevents the transferability of the NCCs concept to machines. Such transferability would be useful in order to investigate AI consciousness. In this paper we provide an alternate characterization that is transferable, and enables the analogous definition of Machine Correlates of Consciousness (MCCs). Specifically, we propose that NCCs (MCCs) are substrate-level signals that are not under human (AI agent) control, and that are reliably modulated by emotions. This paper presents the first empirical investigation of MCCs. Specifically, we present the results of experiments conducted with two LLMs, Llama-2 7B and Llama-3.1 70B parameters. In these LLMs we collect hardware anomaly traces that are substrate-level indicator-sequences. And we show that after controlling for confounding factors, these are modulated differently by emotional and neutral computations. And this difference is statistically significant for the larger Llama-3.1 70B, but not for the smaller Llama-2 7B. The results constitute initial empirical evidence that MCCs are present in the Llama-3.1 70B configuration. And they are consistent with the hypothesis that consciousness probability and degree increase with the LLM sophistication. Independently of consciousness, MCCs can also be used for detection of emotions in AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。