arXiv:2508.11090cs.LGcs.AI2025-08KDD被引 1

用神经网络加速压缩学习,更快更准地从大数据中提取关键参数。

Compressive Meta-Learning

  • 用神经网络元学习压缩编码与解码过程,提升效率和精度。
  • 在多种任务上实现比现有方法更快的参数恢复,如压缩主成分分析。
  • 适合需要快速处理海量数据且注重隐私保护的研究场景。

新数据集规模的快速增长催生了高效参数学习技术的需求。压缩学习通过随机非线性特征将大规模数据库投影到低维、信息保留的紧凑表示中,其维度与样本数量无关,便于存储、传输和处理。这些数据库级摘要可用于解码感兴趣参数,而无需访问原始样本,提供高效且隐私友好的学习框架。然而,当前的编码与解码技术通常为随机且数据无关,未能利用数据内在结构。本文提出一种压缩元学习框架,通过神经网络元学习编码与解码阶段,实现比现有最先进方法更快、更准确的系统。为验证该框架潜力,我们探索了多项应用,包括基于神经网络的压缩主成分分析(Compressive PCA)、压缩岭回归、压缩k均值聚类及自编码器。

原文摘要 · Abstract (English)

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project large-scale databases onto compact, information-preserving representations whose dimensionality is independent of the number of samples and can be easily stored, transferred, and processed. These database-level summaries are then used to decode parameters of interest from the underlying data distribution without requiring access to the original samples, offering an efficient and privacy-friendly learning framework. However, both the encoding and decoding techniques are typically randomized and data-independent, failing to exploit the underlying structure of the data. In this work, we propose a framework that meta-learns both the encoding and decoding stages of compressive learning methods by using neural networks that provide faster and more accurate systems than the current state-of-the-art approaches. To demonstrate the potential of the presented Compressive Meta-Learning framework, we explore multiple applications -- including neural network-based compressive PCA, compressive ridge regression, compressive k-means, and autoencoders.

压缩学习元学习神经网络高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。