用神经网络加速压缩学习,更快更准地从大数据中提取关键参数。
Compressive Meta-Learning
- 用神经网络元学习压缩编码与解码过程,提升效率和精度。
- 在多种任务上实现比现有方法更快的参数恢复,如压缩主成分分析。
- 适合需要快速处理海量数据且注重隐私保护的研究场景。
新数据集规模的快速增长催生了高效参数学习技术的需求。压缩学习通过随机非线性特征将大规模数据库投影到低维、信息保留的紧凑表示中,其维度与样本数量无关,便于存储、传输和处理。这些数据库级摘要可用于解码感兴趣参数,而无需访问原始样本,提供高效且隐私友好的学习框架。然而,当前的编码与解码技术通常为随机且数据无关,未能利用数据内在结构。本文提出一种压缩元学习框架,通过神经网络元学习编码与解码阶段,实现比现有最先进方法更快、更准确的系统。为验证该框架潜力,我们探索了多项应用,包括基于神经网络的压缩主成分分析(Compressive PCA)、压缩岭回归、压缩k均值聚类及自编码器。
原文摘要 · Abstract (English)
The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project large-scale databases onto compact, information-preserving representations whose dimensionality is independent of the number of samples and can be easily stored, transferred, and processed. These database-level summaries are then used to decode parameters of interest from the underlying data distribution without requiring access to the original samples, offering an efficient and privacy-friendly learning framework. However, both the encoding and decoding techniques are typically randomized and data-independent, failing to exploit the underlying structure of the data. In this work, we propose a framework that meta-learns both the encoding and decoding stages of compressive learning methods by using neural networks that provide faster and more accurate systems than the current state-of-the-art approaches. To demonstrate the potential of the presented Compressive Meta-Learning framework, we explore multiple applications -- including neural network-based compressive PCA, compressive ridge regression, compressive k-means, and autoencoders.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。