arXiv:2603.27611cs.AIq-bio.NC2026-03

提出自修改系统的四类机制,揭示人类与人工智能在自我认知上的根本差异。

What does a system modify when it modifies itself?

论文配图:What does a system modify when it modifies itself?
图 1 · 摘自论文原文
  • 构建规则层级结构,区分操作、表征与因果可及规则
  • 发现人类高层自知但底层不透明,AI则相反
  • 为人工意识提供可验证的理论框架,适合认知科学与AI交叉研究

当认知系统修改自身时,究竟修改的是底层规则、控制规则,还是评估自身修正的规范?尽管认知科学已精确描述执行控制、元认知与分层学习,却缺乏区分这些目标的正式框架。当代人工智能虽具备自修改能力,但缺乏与生物认知比较的共同标准。本文揭示:自修改系统需具备最小结构——规则层级、固定核心,以及有效规则、表征规则与因果可及规则的区分。识别出四种模式:(1)无修改的行为,(2)低层修改,(3)结构性修改,(4)目的性重构。每种模式对应一个认知现象与人工系统实例。应用于人类,得出核心发现:‘透明度交叉’——人类在高层具有自我表征与因果能力,而操作层高度不透明;反观反射式人工智能,在操作层有丰富表征与因果访问,但在最高评估层完全缺失。这种交叉不对称性构成人机对比的结构标志。该框架还为高阶意识理论与注意力图式理论提供统一视角。推导出四项可检验预测,并指出四大开放问题:可变性与自主性的独立性、自修改的可行性、目的性锁定,以及变换中的身份连续性。

原文摘要 · Abstract (English)

When a cognitive system modifies its own functioning, what exactly does it modify: a low-level rule, a control rule, or the norm that evaluates its own revisions? Cognitive science describes executive control, metacognition, and hierarchical learning with precision, but lacks a formal framework distinguishing these targets of transformation. Contemporary artificial intelligence likewise exhibits self-modification without common criteria for comparison with biological cognition. We show that the question of what counts as a self-modifying system entails a minimal structure: a hierarchy of rules, a fixed core, and a distinction between effective rules, represented rules, and causally accessible rules. Four regimes are identified: (1) action without modification, (2) low-level modification, (3) structural modification, and (4) teleological revision. Each regime is anchored in a cognitive phenomenon and a corresponding artificial system. Applied to humans, the framework yields a central result: a crossing of opacities. Humans have self-representation and causal power concentrated at upper hierarchical levels, while operational levels remain largely opaque. Reflexive artificial systems display the inverse profile: rich representation and causal access at operational levels, but none at the highest evaluative level. This crossed asymmetry provides a structural signature for human-AI comparison. The framework also offers insight into artificial consciousness, with higher-order theories and Attention Schema Theory as special cases. We derive four testable predictions and identify four open problems: the independence of transformativity and autonomy, the viability of self-modification, the teleological lock, and identity under transformation.

自修改认知科学人工智能意识理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。