对比五种芯片发现:新平台模型结果差异超5%,兼容性隐患多。
Mind the Gap: Revealing Inconsistencies Across Heterogeneous AI Accelerators
- 自动化生成万级模型,跨五种主流加速器实测运行
- 华为、苹果平台支持算子少17%以上,输出误差超5%
- 揭示PyTorch漏洞与厂商特有问题,适合硬件适配研究者参考
尽管NVIDIA仍是云数据中心中占主导地位的AI加速器,但AMD、Intel、Mac和华为等新兴厂商提供了更具成本效益的替代方案,并声称具备兼容性和性能优势。本文首次通过实证研究揭示了异构AI加速器之间机器学习模型行为的不一致性。我们构建自动化流水线,从4,000个真实模型生成超过10万种变体,并在五种企业级加速器上执行。结果显示,苹果和华为的新平台至少比NVIDIA少支持17%的算子;这些平台还表现出更高的输出差异率(超过5%),主要源于算子实现差异、异常数值处理及指令调度不同。此外,它们在基于编译的加速过程中更易失败,部分编译模型输出与标准执行模式明显不同。我们还发现了PyTorch中的7个实现缺陷,以及各厂商共40个特定问题。这些结果凸显了在日益多样化的硬件生态中实现一致机器学习行为的巨大挑战。
原文摘要 · Abstract (English)
While NVIDIA remains the dominant provider of AI accelerators within cloud data center, emerging vendors such as AMD, Intel, Mac, and Huawei offer cost-effective alternatives with claims of compatibility and performance. This paper presents the first empirical study investigating divergence in machine learning model across heterogeneous AI accelerators. Utilizing an automated pipeline, we synthesize over 100,000 variant models derived from 4,000 real-world models and execute them across five different enterprise-grade accelerators. Our findings suggest that newer AI platforms from Mac and Huawei support at least 17\% fewer operators than NVIDIA. These platforms also exhibit a higher rate of output discrepancies (exceeding 5\%), which stem from differences in operator implementations, handling of exceptional numerical values, and instruction scheduling. They are also more susceptible to failures during model compilation-based acceleration, and in some cases, the compiled models produce outputs that differ noticeably from those generated using the standard execution mode. In addition, we identify 7 implementation flaws in PyTorch and 40 platform-specific issues across vendors. These results underscore the challenges of achieving consistent machine learning behavior in an increasingly diverse hardware ecosystem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。