arXiv:2604.17862cs.LGcs.AR2026-04中稿 · appear at ISCA 202…

M100用数据流架构替代缓存,提升自动驾驶与大模型推理效率。

M100: An Orchestrated Dataflow Architecture Powering General AI Computing

论文配图:M100: An Orchestrated Dataflow Architecture Powering General AI Computing
图 1 · 摘自论文原文
  • 以张量为单位调度数据流,编译器与硬件协同控制计算与传输
  • 在自动驾驶任务中性能超越GPGPU,利用率更高
  • 适合汽车智能化场景,兼顾通用性与成本效益

随着基于深度学习的AI技术快速发展,通用AI计算架构的需求持续增长。虽然通用图形处理器(GPGPU)能支持多样化的AI负载,但常因效率和成本问题受限;各类专用架构(DSAs)虽在特定任务上表现优异,却难以扩展至更广泛的应用或适应快速演进的AI生态。M100是小鹏汽车提出的高性能、低成本通用AI推理架构,适用于自动驾驶(AD)、大语言模型(LLMs)及智能人机交互等关键汽车平台领域。该架构采用数据流并行设计,通过编译器-架构联合优化,不仅管理计算,更精细调控时间与空间上的数据流动。利用数据流计算优势,软硬协同设计显著提升系统性能,同时降低硬件复杂度与成本。M100大幅减少甚至消除缓存依赖,张量运算由编译器与运行时管理的数据流驱动,在计算单元与片上/外存储间流动,实现比传统缓存系统更高的效率与可扩展性。另一核心原则是合理选择操作粒度,确保在编译器、固件与硬件层面的调度、分发与执行一致。鉴于各类AI负载的共性,团队将张量作为基本数据单元。M100在包括UniAD(自动驾驶)和LLaMA(大语言模型)在内的多种推理任务中展现通用能力。基准测试表明,其在自动驾驶应用中性能优于现有GPGPU架构,且利用率更高,为未来通用AI计算提供了可行方向。

原文摘要 · Abstract (English)

As deep learning-based AI technologies gain momentum, the demand for general-purpose AI computing architectures continues to grow. While GPGPU-based architectures offer versatility for diverse AI workloads, they often fall short in efficiency and cost-effectiveness. Various Domain-Specific Architectures (DSAs) excel at particular AI tasks but struggle to extend across broader applications or adapt to the rapidly evolving AI landscape. M100 is Li Auto's response: a performant, cost-effective architecture for AI inference in Autonomous Driving (AD), Large Language Models (LLMs), and intelligent human interactions, domains crucial to today's most competitive automobile platforms. M100 employs a dataflow parallel architecture, where compiler-architecture co-design orchestrates not only computation but, more critically, data movement across time and space. Leveraging dataflow computing efficiency, our hardware-software co-design improves system performance while reducing hardware complexity and cost. M100 largely eliminates caching: tensor computations are driven by compiler- and runtime-managed data streams flowing between computing elements and on/off-chip memories, yielding greater efficiency and scalability than cache-based systems. Another key principle was selecting the right operational granularity for scheduling, issuing, and execution across compiler, firmware, and hardware. Recognizing commonalities in AI workloads, we chose the tensor as the fundamental data element. M100 demonstrates general AI computing capability across diverse inference applications, including UniAD (for AD) and LLaMA (for LLMs). Benchmarks show M100 outperforms GPGPU architectures in AD applications with higher utilization, representing a promising direction for future general AI computing.

AI芯片数据流架构自动驾驶大模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。