arXiv:2509.26300cs.LGcs.DC2025-09被引 4

给自动调优器本身做超参优化,性能平均提升94.8%。

Tuning the Tuner: Introducing Hyperparameter Optimization for Auto-Tuning

  • 用统计方法评估不同超参在多种搜索空间的表现
  • 有限调优使自动调优器性能平均提升94.8%
  • 提供可复现数据集和模拟模式,降低调优成本100倍

自动性能调优广泛用于科学领域中优化关键应用,通过在众多程序变体中寻找最佳方案。高效的优化算法对探索庞大复杂的搜索空间至关重要。尽管在机器学习等领域中,超参数显著影响优化效率,但在自动调优框架中,这些超参数几乎从未被调整,其潜在影响也未被研究。本文提出一种通用的优化算法超参调优方法,即“调优调优器”。我们设计了一种稳健的统计方法以跨搜索空间评估超参表现,发布符合FAIR原则的数据集与软件以确保可复现性,并引入模拟模式,可重放已记录的调优数据,使超参调优成本降低两个数量级。实验表明,即使仅进行有限超参调优,也能使自动调优器性能平均提升94.8%;进一步采用元策略优化超参数,平均性能提升达204.7%,验证了超参调优这一常被忽视的技术对推动自动调优研究与实践的强大潜力。

原文摘要 · Abstract (English)

Automatic performance tuning (auto-tuning) is widely used to optimize performance-critical applications across many scientific domains by finding the best program variant among many choices. Efficient optimization algorithms are crucial for navigating the vast and complex search spaces in auto-tuning. As is well known in the context of machine learning and similar fields, hyperparameters critically shape optimization algorithm efficiency. Yet for auto-tuning frameworks, these hyperparameters are almost never tuned, and their potential performance impact has not been studied. We present a novel method for general hyperparameter tuning of optimization algorithms for auto-tuning, thus "tuning the tuner". In particular, we propose a robust statistical method for evaluating hyperparameter performance across search spaces, publish a FAIR data set and software for reproducibility, and present a simulation mode that replays previously recorded tuning data, lowering the costs of hyperparameter tuning by two orders of magnitude. We show that even limited hyperparameter tuning can improve auto-tuner performance by 94.8% on average, and establish that the hyperparameters themselves can be optimized efficiently with meta-strategies (with an average improvement of 204.7%), demonstrating the often overlooked hyperparameter tuning as a powerful technique for advancing auto-tuning research and practice.

自动调优超参优化性能提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。