用非高斯分布提升相关数据的稀疏学习鲁棒性
Maximum Tsallis Entropy Distributions for Robust and Efficient Sparse Learning from Correlated Data
- 基于泰萨斯熵最大化构造新型$ q $高斯分布,替代传统高斯假设
- 提出适配流平衡数值方法的优化框架,提升稀疏学习效率与稳定性
- 适用于基因组、纵向研究等存在相关性与异质性的生物统计场景
本文针对统计稀疏学习中高斯分布假设在建模相关性与异质性数据时的局限性,提出基于泰萨斯熵最大化的$ q $高斯分布作为鲁棒替代。该分布特别适用于生物统计学中的遗传与纵向研究,其中观测值常具相关性且存在异质性。通过重新推导泰萨斯熵最大化的多元概率密度函数,模型有效克服了传统高斯模型对异常值敏感和分布假设不匹配的问题。同时,本文引入一种新框架,将用于求解流平衡的数值方法拓展至复合优化问题,结合Hager-Zhang共轭梯度算法,开发出数值稳定且高效的稀疏学习算法。该方法不仅深化了对统计分布与优化技术的理论理解,也为实际数据分析提供了可行路径。
原文摘要 · Abstract (English)
This paper addresses the limitations of Gaussian distribution assumptions in statistical sparse learning, particularly in modeling correlated and heterogeneous data. Conventional Gaussian models often lack robustness towards outliers and underlying distribution assumptions. To overcome these limitations, we propose the use of the $q$Gaussian distribution, derived from Tsallis entropy maximization, as a robust alternative. This is notably relevant in biostatistics, where the presence of correlated observations and heterogeneity, such as in genetic and longitudinal studies, is prevalent. Our contributions include modeling of correlated data through the re-derived multivariate probability density function from Tsallis entropy maximization, thereby addressing the limitations inherent in conventional Gaussian models. Furthermore, we introduce a novel framework that adapts numerical methods designed to find equilibria in flows to tackle composite optimization problems prevalent in statistical sparse learning. Applying this framework to the Hager-Zhang conjugate gradient algorithm \cite{Hager2005}, we develop a numerically stable and efficient algorithm for sparse statistical learning. The $q$Gaussian distribution, informed by the principle of maximizing Tsallis entropy, presents a viable and flexible alternative to Gaussian-based methods. This paper not only contributes to the theoretical understanding of statistical distributions and optimization techniques, but also paves the way for practical data analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。