arXiv:2411.02322cs.LGcs.AR2024-11ICLR被引 8

用分层自回归扩散模型生成真实感有向无环图,适合系统评测。

LayerDAG: A Layerwise Autoregressive Diffusion Model for Directed Acyclic Graph Generation

  • 将节点依赖拆解为分层二分图序列,逐层生成
  • 可生成含400个节点的大规模有效有向无环图
  • 生成图提升机器学习模型预测准确率,适合芯片设计

有向无环图(DAG)在硬件合成与编译器/程序优化中是关键数据表示。生成式模型可创建用于系统评测的合成DAG,同时保护知识产权。然而,由于其固有的方向性和逻辑依赖性,生成真实DAG极具挑战。本文提出LayerDAG,一种分层自回归扩散模型,通过将强节点依赖分解为可顺序处理的单元,将部分序视为二分图序列,利用自回归机制建模方向依赖,并用扩散模型捕捉每层二分图内的逻辑依赖。对比实验表明,LayerDAG在表达能力和泛化性上优于现有模型,尤其在生成最多含400个节点的大规模DAG方面表现突出。在多个计算平台的真实与合成流程图上的大量实验显示,LayerDAG生成的有效DAG具备优异统计特性与评测性能。这些合成图提升了基于机器学习的代理模型训练效果,显著提高了对真实世界DAG性能指标的预测准确性。

原文摘要 · Abstract (English)

Directed acyclic graphs (DAGs) serve as crucial data representations in domains such as hardware synthesis and compiler/program optimization for computing systems. DAG generative models facilitate the creation of synthetic DAGs, which can be used for benchmarking computing systems while preserving intellectual property. However, generating realistic DAGs is challenging due to their inherent directional and logical dependencies. This paper introduces LayerDAG, an autoregressive diffusion model, to address these challenges. LayerDAG decouples the strong node dependencies into manageable units that can be processed sequentially. By interpreting the partial order of nodes as a sequence of bipartite graphs, LayerDAG leverages autoregressive generation to model directional dependencies and employs diffusion models to capture logical dependencies within each bipartite graph. Comparative analyses demonstrate that LayerDAG outperforms existing DAG generative models in both expressiveness and generalization, particularly for generating large-scale DAGs with up to 400 nodes-a critical scenario for system benchmarking. Extensive experiments on both synthetic and real-world flow graphs from various computing platforms show that LayerDAG generates valid DAGs with superior statistical properties and benchmarking performance. The synthetic DAGs generated by LayerDAG enhance the training of ML-based surrogate models, resulting in improved accuracy in predicting performance metrics of real-world DAGs across diverse computing platforms.

图生成扩散模型DAG系统评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。