arXiv:2505.11984stat.MLcs.LG2025-05

针对多属性高维数据,提出非凸正则化方法提升图结构估计精度。

Multi-Attribute Graph Estimation with Sparse-Group Non-Convex Penalties

  • 采用稀疏组非凸惩罚项优化对数似然函数,实现多属性图学习
  • 在合成数据上,对数和惩罚方法的F1分数和汉明距离显著优于Lasso与SCAD
  • 理论证明支持恢复一致性,适合高维多变量依赖关系建模

本文研究从多属性数据中推断高维高斯向量的条件独立图(CIG)问题。现有方法多基于单属性模型,每个节点对应一个标量随机变量;而多属性图模型中,每个节点代表一个随机向量。本文提供统一的理论分析框架,使用带惩罚的对数似然目标函数进行多属性图学习,涵盖凸(稀疏组Lasso)与稀疏组非凸(Log-sum、SCAD)惩罚。通过结合交替方向乘子法(ADMM)与局部线性近似处理非凸惩罚,实现优化。对于非凸惩罚,在两类充分条件下(含/不含不可表示性条件),建立了高维设置下的局部一致性、局部凸性及精度矩阵估计的理论结果。通过合成与真实数据验证,稀疏组Log-sum惩罚在F1分数和汉明距离指标上显著优于Lasso与SCAD。

原文摘要 · Abstract (English)

We consider the problem of inferring the conditional independence graph (CIG) of high-dimensional Gaussian vectors from multi-attribute data. Most existing methods for graph estimation are based on single-attribute models where one associates a scalar random variable with each node. In multi-attribute graphical models, each node represents a random vector. In this paper we provide a unified theoretical analysis of multi-attribute graph learning using a penalized log-likelihood objective function. We consider both convex (sparse-group lasso) and sparse-group non-convex (log-sum and smoothly clipped absolute deviation (SCAD) penalties) penalty/regularization functions. An alternating direction method of multipliers (ADMM) approach coupled with local linear approximation to non-convex penalties is presented for optimization of the objective function. For non-convex penalties, theoretical analysis establishing local consistency in support recovery, local convexity and precision matrix estimation in high-dimensional settings is provided under two sets of sufficient conditions: with and without some irrepresentability conditions. We illustrate our approaches using both synthetic and real-data numerical examples. In the synthetic data examples the sparse-group log-sum penalized objective function significantly outperformed the lasso penalized as well as SCAD penalized objective functions with $F_1$-score and Hamming distance as performance metrics.

图学习高维统计非凸优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。