arXiv:2604.12891cs.LGcs.AR2026-04

TCL用持续学习加速跨硬件张量程序优化,省时又省力。

TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning

论文配图:TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning
图 1 · 摘自论文原文
  • 通过主动学习只选10%的张量程序,大幅降低数据收集成本。
  • 用轻量Mamba模型预测性能,速度和精度兼顾。
  • 支持多平台知识持续迁移,避免参数爆炸,适合异构部署。

深度学习编译器依赖成本模型和自动调优来优化目标硬件上的张量程序。然而,现有方法依赖大规模离线数据集,导致数据收集成本高,且跨平台迁移能力差。本文提出TCL,一种高效且可迁移的编译框架,实现跨多种硬件平台的快速张量程序优化。TCL基于三大核心机制:(1) RDU采样器,一种数据高效的主动学习策略,通过联合优化代表性、多样性和不确定性,仅选取10%的张量程序,在保持接近原始模型精度的同时显著降低数据收集成本;(2) 基于Mamba的新成本模型,以减少参数化和轻量序列建模方式高效捕捉长程调度依赖,在预测精度与计算开销间取得良好平衡;(3) 持续知识蒸馏框架,能有效且渐进地在多个硬件平台间迁移知识,避免传统多任务学习带来的参数爆炸与数据依赖问题。大量实验验证了各组件及整体TCL的有效性。在主流DL模型上对CPU和GPU平台进行优化时,TCL平均分别达到16.8倍和12.48倍的调优速度提升,推理延迟分别降低1.20倍和1.13倍,优于Tenset-MLP。

原文摘要 · Abstract (English)

Deep learning (DL) compilers rely on cost models and auto-tuning to optimize tensor programs for target hardware. However, existing approaches depend on large offline datasets, incurring high collection costs and offering suboptimal transferability across platforms. In this paper, we introduce TCL, a novel efficient and transferable compiler framework for fast tensor program optimization across diverse hardware platforms to address these challenges. Specifically, TCL is built on three core enablers: (1) the RDU Sampler, a data-efficient active learning strategy that selects only 10% of tensor programs by jointly optimizing Representativeness, Diversity, and Uncertainty, substantially reducing data collection costs while maintaining near-original model accuracy; (2) a new Mamba-based cost model that efficiently captures long-range schedule dependencies while achieving a favorable trade-off between prediction accuracy and computational cost through reduced parameterization and lightweight sequence modeling; and (3) a continuous knowledge distillation framework that effectively and progressively transfers knowledge across multiple hardware platforms while avoiding the parameter explosion and data dependency issues typically caused by traditional multi-task learning. Extensive experiments validate the effectiveness of each individual enabler and the holistic TCL framework. When optimizing a range of mainstream DL models on both CPU and GPU platforms, TCL achieves, on average, 16.8x and 12.48x faster tuning time, and 1.20x and 1.13x lower inference latency, respectively, compared to Tenset-MLP.

编译优化持续学习张量程序Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。