arXiv:2509.17205cs.LG2025-09

用强化学习动态求解带变化约束的问题,可自适应不同条件。

Conditional Policy Generator for Dynamic Constraint Satisfaction and Optimization

  • 将问题建模为强化学习,通过条件策略生成器处理动态约束。
  • 在多模态问题中验证,条件版本比无条件方法更准确。
  • 适合需要实时响应环境变化的优化场景,如智能调度系统。

利用机器学习求解约束满足问题虽具前景,但大多局限于问题描述完全已知且固定的静态情形。本文提出一种在动态变化环境中求解约束满足与优化的新方法,尤其适用于变量间统计独立的问题。将该问题建模为强化学习任务,引入基于类别条件生成对抗网络(GAN)思想的条件策略生成器。假设问题包含静态与动态约束:静态约束用于构造奖励函数,引导策略学习从噪声先验映射到满足静态约束的解的分布,类似 GAN 中的生成器;动态约束则被编码为不同类别标签,与输入噪声一同输入,策略通过监督方式同时更新以最大化对给定动态条件的正确分类概率。我们在一个多模态约束满足问题上进行了原理性实验,对比了无条件与条件情况下的表现,验证了方法的有效性。

原文摘要 · Abstract (English)

Leveraging machine learning methods to solve constraint satisfaction problems has shown promising, but they are mostly limited to a static situation where the problem description is completely known and fixed from the beginning. In this work we present a new approach to constraint satisfaction and optimization in dynamically changing environments, particularly when variables in the problem are statistically independent. We frame it as a reinforcement learning problem and introduce a conditional policy generator by borrowing the idea of class conditional generative adversarial networks (GANs). Assuming that the problem includes both static and dynamic constraints, the former are used in a reward formulation to guide the policy training such that it learns to map to a probabilistic distribution of solutions satisfying static constraints from a noise prior, which is similar to a generator in GANs. On the other hand, dynamic constraints in the problem are encoded to different class labels and fed with the input noise. The policy is then simultaneously updated for maximum likelihood of correctly classifying given the dynamic conditions in a supervised manner. We empirically demonstrate a proof-of-principle experiment with a multi-modal constraint satisfaction problem and compare between unconditional and conditional cases.

强化学习约束满足动态优化生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。