arXiv:2608.26375cs.LGcs.AI2026-08

让AI模型在训练时满足预设约束,提升可靠性与安全性。

CG4AI: A Column Generation Framework for Training AI Models Under Constraints

论文配图:CG4AI: A Column Generation Framework for Training AI Models Under Constraints
图 1 · 摘自论文原文
  • 用线性规划优化多个模型的组合权重,强制输出符合约束
  • 在MNIST上实现4种约束应用,准确率高于单模型基准
  • 适用于自动驾驶、网络路由等需严格合规的场景

标准机器学习训练仅最小化损失函数,无法保证模型输出满足预设规则。在自动驾驶、网络路由等实际应用中,此类保障至关重要。本文提出CG4AI框架,通过凸组合方式融合多个AI模型,并在组合输出上施加线性约束。主问题为线性规划(LP),确定最优混合权重;子问题根据对偶变量生成新模型,聚焦于最违例的约束。割平面法将可行性保证扩展至训练集外。实验在两个任务上验证:(i) MNIST数字分类,展示四类约束应用——仅从约束学习、提升对抗鲁棒性、修正误分类样本、强制输出重标;(ii) 多商品流问题,对神经网络路由预测器施加链路容量约束。在MNIST及标准SNDLIB网络基准上,CG4AI能可靠生成可行预测器,且准确率优于单模型基线。

原文摘要 · Abstract (English)

Standard machine-learning training minimizes a loss function over a dataset, but does not guarantee that the resulting model will satisfy predefined rules or constraints on its outputs. In many real-world applications, ranging from autonomous systems to network routing, such guarantees are essential. We propose CG4AI, a framework that builds a convex combination of AI models while enforcing linear constraints on the combined output. A master linear program (LP) determines the optimal mixture weights, while a pricing subproblem generates new models guided by LP dual variables, focusing attention on the most violated constraints. A cutting-plane procedure extends feasibility guarantees beyond the training set. We apply CG4AI to two problems: (i) digit classification on MNIST, where we demonstrate four distinct uses of constraints, learning from constraints alone, improving adversarial robustness, correcting misclassified examples, and enforcing output relabeling; and (ii) the multi-commodity flow problem, where link capacity constraints are enforced on neural-network routing predictors. Experiments on MNIST and standard SNDLIB benchmark networks show that CG4AI reliably produces feasible predictors while achieving better accuracy than single-model baselines.

约束学习模型组合可解释性鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。