arXiv:2605.06187cs.LGcs.AI2026-05被引 2

让优化器同时利用多种不可靠反馈,提升搜索效率与鲁棒性。

In-Context Black-Box Optimization with Unreliable Feedback

论文配图:In-Context Black-Box Optimization with Unreliable Feedback
图 1 · 摘自论文原文
  • 基于反馈源差异建模,预训练可感知反馈可靠性的Transformer
  • 在真实与合成任务上显著优于基线,抗误导反馈能力强
  • 适合有多个专家或模拟器辅助的科学工程优化场景

科学与工程中的黑箱优化常伴随辅助信息:专家意见、模拟器或预训练预测器可提示候选解的潜力。这些信息能加速搜索,但可能偏倚、依赖输入或误导。现有反馈感知贝叶斯优化方法通常仅处理单一任务,难以跨任务泛化。而上下文优化器虽支持跨任务适应,但通常仅依赖历史查询数据。本文提出反馈感知的上下文黑箱优化(FICBO),预训练优化器同时利用观测历史与当前候选集的廉价辅助反馈。引入结构化反馈先验,建模不同反馈源在访问权限、相关性及失真程度上的差异,并据此训练反馈感知Transformer。测试时,模型通过对比目标值与辅助信号,动态估计各源可靠性,从而优化查询选择。在合成与真实任务上,FICBO有效利用有效反馈,对弱或误导性来源仍保持鲁棒,性能超越其他基线。实证分析揭示了模型对测试阶段反馈源的感知机制,为决策过程提供了可解释性洞察。

原文摘要 · Abstract (English)

Black-box optimization in science and engineering often comes with side information: experts, simulators, pretrained predictors, or heuristics can suggest which candidates look promising. This information can accelerate search, but it can also be biased, input-dependent, or misleading. Feedback-aware BO methods typically handle one task at a time, limiting their ability to generalize over multiple sources of feedback. In-context optimizers address cross-task adaptation, but usually assume that optimization history is the only available signal at test time. We study feedback-informed in-context black-box optimization (FICBO), where a pretrained optimizer conditions on both the observed history and cheap auxiliary feedback for the current candidate set. We introduce a structured feedback prior that models how feedback sources vary in their access, relevance, and distortion relative to the true objective, and use it to pretrain a feedback-aware transformer. At test time, the model estimates source reliability in context by comparing observed objective values with auxiliary signals, improving query selection. On synthetic and real-world tasks, FICBO effectively exploits informative feedback while remaining robust to weak or misleading sources, improving over other baselines. Empirical investigations further illustrate how the model perceives test-time sources, offering insights into its interpretability and decision-making process.

黑箱优化反馈感知上下文学习可靠性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。