arXiv:2412.19241cs.LGcs.AI2024-12被引 1

提出通用模型预测分类器推理时延与能耗,助力高效负责任的AI部署。

Latenrgy: Model Agnostic Latency and Energy Consumption Prediction for Binary Classifiers

  • 构建理论框架,融合分类器、数据集和AI伦理措施三要素
  • 推导出跨模型通用的时延与能耗预测公式
  • 适合关注推理效率与伦理平衡的研究者与工程师

机器学习系统在科研与产业中推动创新,但推理阶段的计算开销限制了其可扩展性与可持续性。负责任AI机制(RAI)虽保障公平、透明与隐私,却进一步增加计算负担。本文针对现有研究中缺乏通用预测方法、分类器间对比不足、以及RAI对推理性能影响未量化等关键空白,采用理论建构方法,构建了一个模型无关的理论框架,用于预测二分类模型在推理过程中的延迟与能耗。该框架将分类器特性、数据集属性与RAI措施整合为统一分析工具,推导出两个能捕捉多因素交互的通用预测方程,具备跨模型泛化能力。研究成果为设计高效、负责任的ML系统提供基础洞见,支持研究人员进行性能基准测试与优化,协助实践者部署可扩展解决方案。最终,本工作建立了计算效率与伦理原则平衡的理论基础,为后续实证验证与更广泛应用铺平道路。

原文摘要 · Abstract (English)

Machine learning systems increasingly drive innovation across scientific fields and industry, yet challenges in compute overhead, specifically during inference, limit their scalability and sustainability. Responsible AI guardrails, essential for ensuring fairness, transparency, and privacy, further exacerbate these computational demands. This study addresses critical gaps in the literature, chiefly the lack of generalized predictive techniques for latency and energy consumption, limited cross-comparisons of classifiers, and unquantified impacts of RAI guardrails on inference performance. Using Theory Construction Methodology, this work constructed a model-agnostic theoretical framework for predicting latency and energy consumption in binary classification models during inference. The framework synthesizes classifier characteristics, dataset properties, and RAI guardrails into a unified analytical instrument. Two predictive equations are derived that capture the interplay between these factors while offering generalizability across diverse classifiers. The proposed framework provides foundational insights for designing efficient, responsible ML systems. It enables researchers to benchmark and optimize inference performance and assists practitioners in deploying scalable solutions. Finally, this work establishes a theoretical foundation for balancing computational efficiency with ethical AI principles, paving the way for future empirical validation and broader applications.

模型预测推理优化责任AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。