arXiv:2504.06531cs.ARcs.AI2025-04被引 3

面对摩尔定律失效,提出软硬件协同设计新范式。

Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design

  • 重构软硬件边界,推动协同设计成为系统核心。
  • 指出传统抽象已过时,需重新定义计算架构原则。
  • 适合关注未来计算架构与AI硬件优化的研究者。

几十年来,摩尔定律一直是计算机体系结构与系统设计的支柱,形成了软硬件间的清晰抽象。这种传统的摩尔计算范式加深了两者之间的裂痕,使软件开发者无需深入硬件优化即可获得近乎指数级的性能提升。然而如今,摩尔定律所依赖的强劲性能增长已逐渐放缓,面临不可避免的物理瓶颈。这一停滞迫使我们重新审视传统的系统设计哲学。原先保持软硬件严格抽象分离的设计理念日益过时,软件与硬件之间曾经清晰的界限正在迅速消失,取而代之的是协同设计。计算界亟需加强对软硬件协同设计的投入,将系统抽象提升为首要考量,并重新构想设计原则以满足现代计算对性能的无尽需求。软硬件协同设计并非新概念,本文将其发展历程划分为五个相对明确的‘时代’。同时强调了架构社区在跨学科团队(尤其是与机器学习研究者合作)中影响力的上升,并探讨当前协同设计范式在当代计算环境中的困境。此外,文章还引入‘硬件彩票’概念,探索如何缓解其对下一阶段计算创新的制约。本文揭示了从传统解耦向深度融合协同转变的必要性,以及未来突破的关键方向。

原文摘要 · Abstract (English)

For decades, Moore's Law has served as a steadfast pillar in computer architecture and system design, promoting a clear abstraction between hardware and software. This traditional Moore's computing paradigm has deepened the rift between the two, enabling software developers to achieve near-exponential performance gains often without needing to delve deeply into hardware-specific optimizations. Yet today, Moore's Law -- with its once relentless performance gains now diminished to incremental improvements -- faces inevitable physical barriers. This stagnation necessitates a reevaluation of the conventional system design philosophy. The traditional decoupled system design philosophy, which maintains strict abstractions between hardware and software, is increasingly obsolete. The once-clear boundary between software and hardware is rapidly dissolving, replaced by co-design. It is imperative for the computing community to intensify its commitment to hardware-software co-design, elevating system abstractions to first-class citizens and reimagining design principles to satisfy the insatiable appetite of modern computing. Hardware-software co-design is not a recent innovation. To illustrate its historical evolution, I classify its development into five relatively distinct ``epochs''. This post also highlights the growing influence of the architecture community in interdisciplinary teams -- particularly alongside ML researchers -- and explores why current co-design paradigms are struggling in today's computing landscape. Additionally, I will examine the concept of the ``hardware lottery'' and explore directions to mitigate its constraining influence on the next era of computing innovation.

软硬件协同摩尔定律架构设计计算范式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。