为二值数据设计高效架构分析方法,提升模式识别精度。
Archetypal Analysis for Binary Data
- 基于伯努利分布构建二阶近似优化框架,支持闭式更新。
- 在合成与真实二值数据上优于现有乘法更新方法。
- 可扩展至其他数据分布,适合需要高效分解的场景。
架构分析(AA)是一种矩阵分解方法,通过数据点的凸组合识别出代表性的模式(称为原型),每个数据点均可由原型的凸组合重构,从而形成表示数据中不同方面权衡的多面体。现有大多数AA方法针对连续数据设计,未充分利用数据分布结构。本文提出两种针对二值数据的新优化框架:一、基于伯努利分布的AA似然二阶近似,采用活动集法进行原型定义的凸组合学习,并使用序列最小优化策略学习观测特定的重构;二、基于伯努利似然的主凸包分析(PCHA)算法,原用于最小二乘优化。我们在合成与真实二值数据上对比了现有基于乘法更新的二值AA方法,验证了所提框架的优越性。值得注意的是,这些优化框架可轻松推广至其他数据分布,为基于适配似然函数的高效AA提供通用解决方案。
原文摘要 · Abstract (English)
Archetypal analysis (AA) is a matrix decomposition method that identifies distinct patterns using convex combinations of the data points denoted archetypes with each data point in turn reconstructed as convex combinations of the archetypes. AA thereby forms a polytope representing trade-offs of the distinct aspects in the data. Most existing methods for AA are designed for continuous data and do not exploit the structure of the data distribution. In this paper, we propose two new optimization frameworks for archetypal analysis for binary data. i) A second order approximation of the AA likelihood based on the Bernoulli distribution with efficient closed-form updates using an active set procedure for learning the convex combinations defining the archetypes, and a sequential minimal optimization strategy for learning the observation specific reconstructions. ii) A Bernoulli likelihood based version of the principal convex hull analysis (PCHA) algorithm originally developed for least squares optimization. We compare these approaches with the only existing binary AA procedure relying on multiplicative updates and demonstrate their superiority on both synthetic and real binary data. Notably, the proposed optimization frameworks for AA can easily be extended to other data distributions providing generic efficient optimization frameworks for AA based on tailored likelihood functions reflecting the underlying data distribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。