从主观判断中自动学习感知空间的维度与相似性结构。
LORE: Jointly Learning the Intrinsic Dimensionality and Relative Similarity Structure From Ordinal Data
- 用非凸低秩正则化同时优化嵌入维度和相似性关系。
- 在合成数据与真实众包判断上均实现高精度低维嵌入。
- 适合心理物理学与机器学习中的低维结构发现任务。
从如味觉、嗅觉或美学等主观感知空间的序数数据中学习其内在维度是一项挑战性任务。我们提出LORE(低秩序数嵌入),一种可扩展框架,能从噪声三角形比较(如“A是否比C更像B?”)中联合学习内在维度与序数嵌入。不同于需预先设定嵌入维度的现有方法,LORE采用非凸Schatten-p拟范数进行正则化,实现维度与嵌入的自动联合恢复。通过迭代重加权算法优化目标函数,并建立收敛性保证。在合成数据、模拟感知空间及真实世界众包序数判断上的大量实验表明,LORE能学习到紧凑、可解释且高度准确的低维嵌入,有效还原主观感知的潜在几何结构。同时推断内在维度与序数嵌入,使心理物理学中的感知建模更具可解释性与数据效率,并为机器学习中从序数数据中发现低维结构开辟新方向。
原文摘要 · Abstract (English)
Learning the intrinsic dimensionality of subjective perceptual spaces such as taste, smell, or aesthetics from ordinal data is a challenging problem. We introduce LORE (Low Rank Ordinal Embedding), a scalable framework that jointly learns both the intrinsic dimensionality and an ordinal embedding from noisy triplet comparisons of the form, "Is A more similar to B than C?". Unlike existing methods that require the embedding dimension to be set apriori, LORE regularizes the solution using the nonconvex Schatten-$p$ quasi norm, enabling automatic joint recovery of both the ordinal embedding and its dimensionality. We optimize this joint objective via an iteratively reweighted algorithm and establish convergence guarantees. Extensive experiments on synthetic datasets, simulated perceptual spaces, and real world crowdsourced ordinal judgements show that LORE learns compact, interpretable and highly accurate low dimensional embeddings that recover the latent geometry of subjective percepts. By simultaneously inferring both the intrinsic dimensionality and ordinal embeddings, LORE enables more interpretable and data efficient perceptual modeling in psychophysics and opens new directions for scalable discovery of low dimensional structure from ordinal data in machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。