arXiv:2606.00288cs.AI2026-06

用计算机架构思维重构大模型系统,提出六层智能计算架构。

Model-Native Computing Architecture: Envisioning Future System Architecture Through the Lens of Computer Architecture

论文配图:Model-Native Computing Architecture: Envisioning Future System Architecture Through the Lens of Computer Architecture
图 1 · 摘自论文原文
  • 将大模型类比为CPU,缓存、上下文等对应硬件层次。
  • 提出ICA架构,分概率执行与确定控制双平面设计。
  • 适合研究大模型系统架构与下一代智能计算的学者。

大型语言模型正从模型技术转向系统技术。缓存复用、上下文容量、代理调度和权限控制等工程挑战,与经典计算机系统问题相似。若将大模型视为CPU,KV缓存为处理器缓存,上下文窗口为主存,代理框架为操作系统,能否借鉴数十年计算机架构经验来指导下一代模型原生系统?本文以此类比展开愿景性综述。我们将计算机架构概念映射至新兴的模型原生栈,调研涵盖LLM作为操作系统、内存管理、代理框架、工具协议、多代理协作、认知架构与安全治理的文献,发现各层面独立发展而缺乏统一模型。为此提出智能计算架构(ICA):六层功能结构,包含接口契约与设计公理。通过双平面架构——概率执行平面(可计算什么)与确定控制平面(应计算什么)——化解大模型是CPU还是操作系统的争议,每层均以渐进式交叉方式贯穿。提出三类阿姆达尔式设计启发:语义局部性、上下文预算、代理加速,并基于已有数据展示参数范围,指出预测验证为首要开放任务。阐明类比边界,指出硅基与模型时代架构差异,提出研究路线图。本工作为概念性与综述贡献,无新实验结果。

原文摘要 · Abstract (English)

Large language models are undergoing a transition from model technology to system technology. Engineering challenges like cache reuse, context capacity, agent scheduling, and permission control resemble classical computer systems problems. This raises a question: if we treat the LLM as a CPU, KV cache as processor cache, context window as main memory, and agent framework as an operating system, can decades of computer architecture wisdom guide next generation model native systems? This paper pursues this analogy as a visionary survey. We map computer architecture concepts onto the emerging model native stack, survey literature across LLM as OS, memory management, agent frameworks, tool protocols, multi agent coordination, cognitive architectures, and safety governance, finding that each addresses a different layer without a unifying model. We propose the Intelligent Computing Architecture (ICA): six functional layers with interface contracts and design axioms. We resolve the tension over whether the LLM resembles a CPU or OS via a dual plane architecture a probabilistic execution plane (what can be computed) and a deterministic control plane (what should be computed), with every layer passing through as a graded crossover. We propose three Amdahl style design heuristics Semantic Locality, Context Budget, and Agent Speedup as organizing back of envelope models, illustrate their parameter ranges with published data, and identify predictive validation as the principal open task. We articulate analogy boundaries, note differences between silicon and model era architectures, and propose a research roadmap. This is a conceptual and survey contribution with no new experimental results.

系统架构大模型智能计算综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。