arXiv:2410.19081cs.LGstat.ML2024-10NeurIPS被引 1

改进生存分析模型训练速度与稳定性,解决高维数据难题。

FastSurvival: Hidden Computational Blessings in Training Cox Proportional Hazards Models

  • 构建代理函数绕过牛顿法收敛难题,确保全局收敛。
  • 实测效率显著提升,可高效求解稀疏性约束的生存模型。
  • 适合高维医疗/工业数据建模,也推动理论研究突破。

生存分析在医疗、商业和制造等领域具有重要意义。其中,比例风险(Cox proportional hazards, CPH)模型因可解释性强、灵活且预测性能好而被广泛应用。然而,面对高维数据(大样本量n和高特征数p)及高特征相关性等现代挑战,现有训练算法存在缺陷,难以充分发挥CPH模型潜力。根本原因在于基于牛顿法的算法在远离最优解区域时二阶导数趋近于零,导致收敛困难。为此,我们提出新优化方法,通过构造并最小化利用了CPH模型隐藏数学结构的代理函数,克服该问题。所提方法易于实现,保证损失单调下降和全局收敛。实验验证了其计算效率。作为直接应用,我们展示了该方法如何有效求解卡数约束下的CPH问题,生成此前难以实现的稀疏高质量模型。本工作还引出了若干扩展方向,包括优化新机会、对CPH数学结构的理论探讨及其他相关应用。

原文摘要 · Abstract (English)

Survival analysis is an important research topic with applications in healthcare, business, and manufacturing. One essential tool in this area is the Cox proportional hazards (CPH) model, which is widely used for its interpretability, flexibility, and predictive performance. However, for modern data science challenges such as high dimensionality (both $n$ and $p$) and high feature correlations, current algorithms to train the CPH model have drawbacks, preventing us from using the CPH model at its full potential. The root cause is that the current algorithms, based on the Newton method, have trouble converging due to vanishing second order derivatives when outside the local region of the minimizer. To circumvent this problem, we propose new optimization methods by constructing and minimizing surrogate functions that exploit hidden mathematical structures of the CPH model. Our new methods are easy to implement and ensure monotonic loss decrease and global convergence. Empirically, we verify the computational efficiency of our methods. As a direct application, we show how our optimization methods can be used to solve the cardinality-constrained CPH problem, producing very sparse high-quality models that were not previously practical to construct. We list several extensions that our breakthrough enables, including optimization opportunities, theoretical questions on CPH's mathematical structure, as well as other CPH-related applications.

生存分析优化算法高维数据医学建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。