让人类专家参与优化,还能自动调节信任度,不犯错还省力。
Principled Bayesian Optimisation in Collaboration with Human Experts
- 基于二元反馈设计自适应信任机制,动态调整专家建议权重。
- 理论证明:专家标签数量随时间趋于零,节省人力与计算成本。
- 适合需要专家协作的复杂优化场景,如电池设计等实际应用。
现实世界中的贝叶斯优化常需与人类专家交互,融入其领域知识可显著加速过程。本文考虑专家通过二元接受/拒绝标签推荐下一步查询点的场景。专家标签代价高,且可能不可靠,需高效利用并合理调控信任程度。本文提出首个具备严格理论保障的方法:(1) 手动交接保证——类似无悔性质,建立累积标签数量的次线性上界;初期需多标签,但随时间推移,所需标签数渐趋零,大幅节省专家投入与计算开销。(2) 不伤性能保证——结合数据驱动的信任调节,即使专家建议为对抗性误导,优化收敛速度也不会劣于不使用建议的情况。相比现有依赖人工设定信任函数的方法,本方法实现自动调节。实证结果表明,在电池设计任务中,该方法不仅优于基线,且对标签准确率波动具有强鲁棒性。
原文摘要 · Abstract (English)
Bayesian optimisation for real-world problems is often performed interactively with human experts, and integrating their domain knowledge is key to accelerate the optimisation process. We consider a setup where experts provide advice on the next query point through binary accept/reject recommendations (labels). Experts' labels are often costly, requiring efficient use of their efforts, and can at the same time be unreliable, requiring careful adjustment of the degree to which any expert is trusted. We introduce the first principled approach that provides two key guarantees. (1) Handover guarantee: similar to a no-regret property, we establish a sublinear bound on the cumulative number of experts' binary labels. Initially, multiple labels per query are needed, but the number of expert labels required asymptotically converges to zero, saving both expert effort and computation time. (2) No-harm guarantee with data-driven trust level adjustment: our adaptive trust level ensures that the convergence rate will not be worse than the one without using advice, even if the advice from experts is adversarial. Unlike existing methods that employ a user-defined function that hand-tunes the trust level adjustment, our approach enables data-driven adjustments. Real-world applications empirically demonstrate that our method not only outperforms existing baselines, but also maintains robustness despite varying labelling accuracy, in tasks of battery design with human experts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。