arXiv:2602.07440cs.LG2026-02

通过融合多种选样策略,提升标注效率与模型能效。

Active Learning Using Aggregated Acquisition Functions: Accuracy and Sustainability Analysis

  • 设计六种聚合选样结构,平衡探索与利用
  • 减少12%标注样本,采集成本降低近半
  • 适合追求高效低耗的AI系统研发者

主动学习(AL)通过智能选择最富信息量的样本进行标注,降低标注成本并减少神经网络训练能耗,提升数据与能源效率。本文评估了多种前沿选样函数的准确性与计算开销,发现基于表示性的方法擅长探索数据分布,但忽略边界决策;而基于不确定性的方法聚焦已识别边界,存在探索-利用权衡问题。为此,提出六种聚合结构:串行、并行、混合、自适应反馈、随机探索与退火探索,缓解批量模式低效和冷启动等常见缺陷。实验表明,这些结构在多个模型与数据集上均能以更低计算成本维持或提升精度。例如,交替使用BALD与BADGE,或先用$K$-Centers再接BALD,可在相同性能下减少12%样本量,并使采集成本几乎减半,推动可持续智能发展。

原文摘要 · Abstract (English)

Active learning (AL) is a machine learning (ML) approach that strategically selects the most informative samples for annotation during training, aiming to minimize annotation costs. This strategy not only reduces labeling expenses but also results in energy savings during neural network training, thereby enhancing both data and energy efficiency. In this paper, we implement and evaluate various state-of-the-art acquisition functions, analyzing their accuracy and computational costs, while discussing the advantages and disadvantages of each method. Our findings reveal that representativity-based acquisition functions effectively explore the dataset but do not prioritize boundary decisions, whereas uncertainty-based acquisition functions focus on refining boundary decisions already identified by the neural network. This trade-off is known as the exploration-exploitation dilemma. To address this dilemma, we introduce six aggregation structures: series, parallel, hybrid, adaptive feedback, random exploration, and annealing exploration. Our aggregated acquisition functions alleviate common AL pathologies such as batch mode inefficiency and the cold start problem. Additionally, we focus on balancing accuracy and energy consumption, contributing to the development of more sustainable, energy-aware artificial intelligence (AI). We evaluate our proposed structures on various models and datasets. Our results demonstrate the potential of these structures to reduce computational costs while maintaining or even improving accuracy. Innovative aggregation approaches, such as alternating between acquisition functions such as BALD and BADGE, have shown robust results. Sequentially running functions like $K$-Centers followed by BALD has achieved the same performance goals with up to 12\% fewer samples, while reducing the acquisition cost by almost half.

主动学习标注效率能效优化模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。