arXiv:2411.02797cs.PFcs.AI2024-11被引 6

跨平台跨框架的深度学习性能分析工具,精准定位训练推理瓶颈。

DeepContext: A Context-aware, Cross-platform, and Cross-framework Tool for Performance Profiling and Analysis of Deep Learning Workloads

  • 打通Python代码到GPU设备的上下文链路,全栈追踪性能
  • 支持PyTorch/JAX等主流框架,兼容Nvidia/AMD GPU与x86/ARM CPU
  • 内置可视化界面与自动优化建议,快速定位热点与改进点

有效性能分析对优化深度学习模型的训练与推理至关重要,尤其在异构计算环境日益复杂的背景下。现有工具普遍缺乏对复杂CPU-GPU交互中程序上下文信息和优化洞察的全面支持。本文提出DeepContext,一种新型性能剖析工具,可连接高层Python代码、深度学习框架、底层C/C++库以及运行在GPU上的设备代码的程序上下文。DeepContext集成粗粒度与细粒度性能指标测量,支持PyTorch、JAX等主流框架,兼容Nvidia与AMD GPU,以及x86与ARM等多种CPU架构。此外,DeepContext配备创新图形化界面,帮助用户快速识别性能热点,并集成自动化性能分析器,基于性能数据与程序上下文为用户提供潜在优化建议。通过详细用例展示,DeepContext能有效协助用户发现并分析性能问题,实现深度学习工作负载的快速高效优化。我们认为DeepContext是跨多计算环境优化复杂深度学习流程的有力工具。

原文摘要 · Abstract (English)

Effective performance profiling and analysis are essential for optimizing training and inference of deep learning models, especially given the growing complexity of heterogeneous computing environments. However, existing tools often lack the capability to provide comprehensive program context information and performance optimization insights for sophisticated interactions between CPUs and GPUs. This paper introduces DeepContext, a novel profiler that links program contexts across high-level Python code, deep learning frameworks, underlying libraries written in C/C++, as well as device code executed on GPUs. DeepContext incorporates measurements of both coarse- and fine-grained performance metrics for major deep learning frameworks, such as PyTorch and JAX, and is compatible with GPUs from both Nvidia and AMD, as well as various CPU architectures, including x86 and ARM. In addition, DeepContext integrates a novel GUI that allows users to quickly identify hotpots and an innovative automated performance analyzer that suggests users with potential optimizations based on performance metrics and program context. Through detailed use cases, we demonstrate how DeepContext can help users identify and analyze performance issues to enable quick and effective optimization of deep learning workloads. We believe Deep Context is a valuable tool for users seeking to optimize complex deep learning workflows across multiple compute environments.

性能分析深度学习跨平台优化工具

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。