提出高效计算桥型估计路径的新方法,解决非凸稀疏建模难题。
Pathwise optimization for bridge-type estimators and its applications
- 基于非凸优化理论,设计加速近端梯度与分块交替优化算法。
- 实现自适应桥估计在多惩罚下的全路径求解,收敛性与路径一致性可保证。
- 适用于离散观测扩散过程的稀疏参数估计,适合时序数据分析研究者。
稀疏参数模型在统计学习中备受关注,常通过正则化估计器分析。路径法可高效计算惩罚估计器在任意惩罚参数λ下的完整解路径。本文聚焦桥型问题的路径优化:最小化损失函数(如负对数似然或残差平方和)加上ℓ^q范数之和(q∈(0,1]),并引入自适应系数。某些损失函数下,该正则化可实现渐近最优性质(如选择一致性)。然而,由于目标函数包含非凸且不可微项,优化极具挑战。本文将非凸优化中的通用算法应用于多重惩罚下的自适应桥估计路径求解,重点采用加速近端梯度下降与分块交替优化两种方法,并讨论其收敛性与路径一致性。为验证方法有效性,将其应用于离散时间观测的扩散过程的惩罚估计,该问题属于时间依赖数据统计学前沿课题。
原文摘要 · Abstract (English)
Sparse parametric models are of great interest in statistical learning and are often analyzed by means of regularized estimators. Pathwise methods allow to efficiently compute the full solution path for penalized estimators, for any possible value of the penalization parameter $λ$. In this paper we deal with the pathwise optimization for bridge-type problems; i.e. we are interested in the minimization of a loss function, such as negative log-likelihood or residual sum of squares, plus the sum of $\ell^q$ norms with $q\in(0,1]$ involving adpative coefficients. For some loss functions this regularization achieves asymptotically the oracle properties (such as the selection consistency). Nevertheless, since the objective function involves nonconvex and nondifferentiable terms, the minimization problem is computationally challenging. The aim of this paper is to apply some general algorithms, arising from nonconvex optimization theory, to compute efficiently the path solutions for the adaptive bridge estimator with multiple penalties. In particular, we take into account two different approaches: accelerated proximal gradient descent and blockwise alternating optimization. The convergence and the path consistency of these algorithms are discussed. In order to assess our methods, we apply these algorithms to the penalized estimation of diffusion processes observed at discrete times. This latter represents a recent research topic in the field of statistics for time-dependent data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。