arXiv:2603.21590math.STcs.LG2026-03

提出四类增量特征聚类算法,解决动态环境下的数据流聚类问题。

Feature Incremental Clustering with Generalization Bounds

  • 基于k-means改进,设计四种适应特征增量的聚类方法。
  • 理论分析显示算法泛化误差受数据量、模型复杂度等影响。
  • 适合需要长期更新特征的活动识别系统使用。

在许多学习系统中,如活动识别系统,随着新数据采集方法在动态环境应用中的不断涌现,实例属性呈增量积累,数据存储于逐步扩展的特征空间中。如何设计具有理论保障的算法来有效聚类这类特殊数据流——即活动识别数据——仍处于未探索状态。相较于传统场景,这一特征增量场景面临至少两个基本问题:(i) 如何设计初步且有效的算法应对特征增量聚类问题?(ii) 如何分析所提算法的泛化边界,以及在何种条件下这些算法能提供强泛化保证?为此,以最常用的聚类算法k-means为例,我们提出了四种特征增量聚类(FIC)算法,分别对应不同数据访问情境:特征适配(FT)、数据重构(DR)、数据适配(DA)和模型复用(MR),简称FIC-FT、FIC-DR、FIC-DA和FIC-MR。随后,我们对这四种算法的泛化误差边界进行了详细分析,并指出影响边界的关键因素,如训练数据量、假设空间复杂度、预训练模型质量及重构特征分布的差异性。数值实验表明所提算法的有效性,尤其在活动识别聚类任务中表现突出。

原文摘要 · Abstract (English)

In many learning systems, such as activity recognition systems, as new data collection methods continue to emerge in various dynamic environmental applications, the attributes of instances accumulate incrementally, with data being stored in gradually expanding feature spaces. How to design theoretically guaranteed algorithms to effectively cluster this special type of data stream, commonly referred to as activity recognition, remains unexplored. Compared to traditional scenarios, we will face at least two fundamental questions in this feature incremental scenario. (i) How to design preliminary and effective algorithms to address the feature incremental clustering problem? (ii) How to analyze the generalization bounds for the proposed algorithms and under what conditions do these algorithms provide a strong generalization guarantee? To address these problems, by tailoring the most common clustering algorithm, i.e., $k$-means, as an example, we propose four types of Feature Incremental Clustering (FIC) algorithms corresponding to different situations of data access: Feature Tailoring (FT), Data Reconstruction (DR), Data Adaptation (DA), and Model Reuse (MR), abbreviated as FIC-FT, FIC-DR, FIC-DA, and FIC-MR. Subsequently, we offer a detailed analysis of the generalization error bounds for these four algorithms and highlight the critical factors influencing these bounds, such as the amounts of training data, the complexity of the hypothesis space, the quality of pre-trained models, and the discrepancy of the reconstruction feature distribution. The numerical experiments show the effectiveness of the proposed algorithms, particularly in their application to activity recognition clustering tasks.

聚类增量学习泛化界活动识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。