提出新方法实现非可分空间下线性预测聚类的近似最优解。
Near-optimal Linear Predictive Clustering in Non-separable Spaces via MIP and QPBO Reductions
- 通过理论分析降低MIP模型复杂度,提升求解效率
- 在真实与合成数据上误差显著低于贪心法,且速度更快
- 适合需要全局最优且处理重叠簇场景的研究者
线性预测聚类(LPC)基于特征与目标变量间的线性关系划分样本,广泛应用于营销、医学和教育等领域。传统贪心优化方法虽常用,但缺乏全局最优性,尤其在簇间重叠的非可分空间中表现不佳。Bertsimas与Shioda(2007)将LPC建模为混合整数规划(MIP),确保全局最优但扩展性差。本文基于约束优化框架,提出两种新方法:利用可分性理论推导出具有可证明误差界的一阶近似,大幅简化MIP结构;进一步将问题转化为二次伪布尔优化(QPBO),在部分场景下实现显著计算加速。在合成与真实数据集上的对比实验表明,本方法始终获得接近最优解,回归误差远低于贪心算法,且相比现有MIP方法具备更强可扩展性。
原文摘要 · Abstract (English)
Linear Predictive Clustering (LPC) partitions samples based on shared linear relationships between feature and target variables, with numerous applications including marketing, medicine, and education. Greedy optimization methods, commonly used for LPC, alternate between clustering and linear regression but lack global optimality. While effective for separable clusters, they struggle in non-separable settings where clusters overlap in feature space. In an alternative constrained optimization paradigm, Bertsimas and Shioda (2007) formulated LPC as a Mixed-Integer Program (MIP), ensuring global optimality regardless of separability but suffering from poor scalability. This work builds on the constrained optimization paradigm to introduce two novel approaches that improve the efficiency of global optimization for LPC. By leveraging key theoretical properties of separability, we derive near-optimal approximations with provable error bounds, significantly reducing the MIP formulation's complexity and improving scalability. Additionally, we can further approximate LPC as a Quadratic Pseudo-Boolean Optimization (QPBO) problem, achieving substantial computational improvements in some settings. Comparative analyses on synthetic and real-world datasets demonstrate that our methods consistently achieve near-optimal solutions with substantially lower regression errors than greedy optimization while exhibiting superior scalability over existing MIP formulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。