arXiv:2606.23188cs.LG2026-06

分阶段切换编码方式,提升因子分解机黑箱优化效果。

Stage-dependent integer-binary encoding in factorization-machine black-box optimization

论文配图:Stage-dependent integer-binary encoding in factorization-machine black-box optimization
图 1 · 摘自论文原文
  • 学习阶段用独热编码,搜索阶段用域墙编码,动态适配不同任务需求。
  • 在高维细粒度问题中,分阶段编码使残差误差更低,更接近全局最优解。
  • 适合需要高精度优化的场景,如复杂函数求解与硬件加速器协同设计。

黑箱优化(BBO)处理目标函数无显式解析形式且评估代价高的问题。因子分解机结合二次优化退火(FMQA)通过因子分解机(FM)构建代理模型,并利用伊辛机进行优化。传统FMQA在整个优化过程中使用单一整数-二进制编码,但适用于代理学习的最佳编码可能不同于适用于伊辛机求解搜索的编码。本文提出一种分阶段的FMQA框架,推导出独热编码与域墙编码之间的转换公式,确保在可行整数状态上保持代理目标函数不变(仅差一个常数)。我们评估了采用独热编码学习、域墙编码搜索的OhDw变体,在输入维度N=2和5、离散化等级q=61和301的Rastrigin函数上表现。所有条件下,优化性能主要由学习阶段编码决定:独热编码始终比域墙或二进制编码产生更低的残差误差。在搜索阶段切换为域墙编码的额外收益取决于条件:当N=5、q=301时,OhDw的残差误差更低,解更接近全局最优;而当N=5、q=61时,仅用独热编码的表现更优。结果表明,学习阶段使用独热编码是性能关键,分阶段编码在更细粒度下可进一步提升性能。

原文摘要 · Abstract (English)

Black-box optimization (BBO) deals with problems where objective functions lack explicit analytical forms and are expensive to evaluate. Factorization machine with quadratic-optimization annealing (FMQA) constructs a surrogate model using a factorization machine (FM) and optimizes it with an Ising machine. Conventional FMQA applies a single integer-binary encoding throughout the optimization process, although the encoding best suited to surrogate learning may differ from the one best suited to Ising-machine solution search. We propose a stage-dependent FMQA framework and derive conversion formulas between one-hot and domain-wall QUBO matrices that preserve the surrogate objective over feasible integer states up to an additive constant. We evaluate the OhDw variant, which employs one-hot encoding for learning and domain-wall encoding for search, on the Rastrigin function with input dimensions N = 2 and 5 and discretization levels q = 61 and 301. Across all conditions, the dominant factor governing optimization performance is the encoding used in the learning stage, with one-hot encoding consistently yielding lower residual errors than domain-wall or binary encoding. The additional benefit of switching to domain-wall encoding for solution search is condition-dependent. For N = 5 and q = 301, OhDw achieves a lower residual error and solutions closer to the global optimum than one-hot-only FMQA, whereas for N = 5 and q = 61 the latter achieves a lower residual error. These results indicate that one-hot encoding in the learning stage is the primary performance driver and that stage-dependent encoding can provide further improvement under finer discretization.

黑箱优化因子分解机编码策略伊辛机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。