arXiv:2410.05660cs.LGstat.ML2024-10被引 1

通过自适应调整先验,实现低成本函数边界精确估计

Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior

  • 引入可动态调整的高斯过程先验,安全融合相关领域知识
  • 理论证明收敛性优于传统迁移学习方法,误差更低
  • 适用于评估成本高的场景,适合跨任务边界检测应用

针对黑箱函数的主动水平集估计目标,旨在通过迭代采样精确识别函数值超过或低于指定阈值的区域。当函数评估代价高昂时,获取大规模数据集的能力受到严重限制。一种高效的建模方式是利用相关函数的先验知识实现样本高效建模。然而,若先验信息不相关或误导,可能导致估计效率下降。本文提出一种新型迁移学习方法,可在持续自适应调整先验的基础上,安全地融入先验知识,确保即使在先验无关的情况下仍保持水平集估计算法的鲁棒性能。理论上分析表明,该方法相较于不调整先验的标准迁移学习,具有更优的水平集收敛性。大量实验在多个数据集上验证了该方法的有效性,适用于多种水平集估计算法和不同的迁移学习场景。

原文摘要 · Abstract (English)

The objective of active level set estimation for a black-box function is to precisely identify regions where the function values exceed or fall below a specified threshold by iteratively performing function evaluations to gather more information about the function. This becomes particularly important when function evaluations are costly, drastically limiting our ability to acquire large datasets. A promising way to sample-efficiently model the black-box function is by incorporating prior knowledge from a related function. However, this approach risks slowing down the estimation task if the prior knowledge is irrelevant or misleading. In this paper, we present a novel transfer learning method for active level set estimation that safely integrates a given prior knowledge while constantly adjusting it to guarantee a robust performance of a level set estimation algorithm even when the prior knowledge is irrelevant. We theoretically analyze this algorithm to show that it has a better level set convergence compared to standard transfer learning approaches that do not make any adjustment to the prior. Additionally, extensive experiments across multiple datasets confirm the effectiveness of our method when applied to various different level set estimation algorithms as well as different transfer learning scenarios.

水平集估计迁移学习高斯过程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。