arXiv:2410.20172cs.LG2024-10

用变分自编码器在低维空间中解耦变量,可视化金融利率的结构关系。

Alternatives of Unsupervised Representations of Variables on the Latent Space

  • 提出五种变量表征方法,融合统计、相似度与梯度关系。
  • 在真实金融数据上成功按利率类型与期限解耦,定位关键特征。
  • 适合对变量可解释性、数据结构挖掘感兴趣的开发者与分析师。

本文研究通过变分自编码器(beta-VAE)将变量映射到二维隐空间的无监督表示方法。该方法支持数据可视化、变量解耦、模式发现与异常检测,提升模型可解释性。文中提出了五类表征策略:(1) 直接转置;(2) 单变量元数据(如统计量、经验密度函数、累积分布函数);(3) 不同度量的邻接矩阵(如相关系数、R²、Jaccard指数、余弦相似度、互信息);(4) 梯度映射结合点积计算;(5) 多方法融合。共考察28种变量表示方案。点积用于刻画两变量在隐空间轴上的梯度关系,如正交、共混正相关、共混负相关等。方法涵盖特征与标签的通用表示,对分类变量引入增强纠缠机制处理独热编码。实验包括三类数据:(1) 已知依赖关系的合成数据;(2) 手写数字经典数据集MNIST;(3) 加拿大金融市场多变量时间序列利率数据。结果表明,利率在隐空间中正确解耦为债券、国库券、GIC和传统抵押贷款等类型,并沿单一曲线排列,且按期限有序分布。

原文摘要 · Abstract (English)

The article addresses the application of unsupervised machine learning to represent variables on the 2D latent space by applying a variational autoencoder (beta-VAE). Representation of variables on low dimensional spaces allows for data visualization, disentanglement of variables based on underlying characteristics, finding of meaningful patterns and outliers, and supports interpretability. Five distinct methods have been introduced to represent variables on the latent space: (1) straightforward transposed, (2) univariate metadata of variables, such as variable statistics, empirical probability density and cumulative distribution functions, (3) adjacency matrices of different metrics, such as correlations, R2 values, Jaccard index, cosine similarity, and mutual information, (4) gradient mappings followed by spot cross product calculation, and (5) combined. Twenty-eight approaches of variable representations by beta-VAE have been considered. The pairwise spot cross product addresses relationships of gradients of two variables along latent space axes, such as orthogonal, confounded positive, confounded negative, and everything in between. The article addresses generalized representations of variables that cover both features and labels. Dealing with categorical variables, reinforced entanglement has been introduced to represent one-hot encoded categories. The article includes three examples: (1) synthetic data with known dependencies, (2) famous MNIST example of handwritten numbers, and (3) real-world multivariate time series of Canadian financial market interest rates. As a result, unsupervised representations of interest rates on the latent space correctly disentangled rates based on their type, such as bonds, T-bills, GICs, or conventional mortgages, positioned bonds and T-bills along a single curve, and ordered rates by their terms along that curve.

无监督学习变量解耦隐空间表示金融数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。