让贝叶斯优化学会识别决策者多种偏好模式,提升多目标优化效率。
Active Preference Learning over Latent Preference Archetypes for Many-Objective Bayesian Optimization
- 用狄利克雷过程混合模型捕捉多种潜在偏好原型。
- 在合成数据和化工设计中优于现有方法,收敛更快且可解释性更强。
- 适合需要理解用户真实偏好的多目标优化场景。
基于偏好的多目标贝叶斯优化通常假设所有成对比较源自单一潜在效用函数,但现实决策者在不同情境下常表现出多种潜在偏好模式。本文提出一种主动偏好学习框架,从成对比较中推断潜在偏好原型,既能识别当前的权衡策略,又能优化其对应偏好。框架将偏好建模为狄利克雷过程混合的潜在原型,并引入混合感知的信息论查询策略,通过混合采集策略分别聚焦原型识别与原型内优化。在合成基准和真实世界化工过程设计案例中,该方法一致优于现有最先进方法,同时恢复出超越传统单效用模型的可解释偏好结构。提出的混合感知诊断工具进一步量化原型恢复与偏好校准效果,提供优化性能之外的深层洞察。
原文摘要 · Abstract (English)
Preference-based many-objective Bayesian optimization typically assumes that all pairwise comparisons arise from a single latent utility function, despite real decision makers often exhibiting multiple latent preference archetypes across contexts. We propose an active preference learning framework for many-objective Bayesian optimization that infers latent preference archetypes from pairwise comparisons, enabling both the identification of the active trade-off strategy and the refinement of its associated preferences. Our framework represents preferences as a Dirichlet-process mixture of latent archetypes and introduces mixture-aware information-theoretic query strategies that separately target archetype identification and within-archetype refinement through a hybrid acquisition policy. Experiments on synthetic benchmarks and real-world chemical process design case-study consistently outperforms state-of-the-art preference-based Bayesian optimization methods while recovering interpretable latent preference structure beyond conventional single-utility models. The proposed mixture-aware diagnostics further quantify archetype recovery and preference calibration, providing insights that are not captured by optimization performance alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。