arXiv:2409.17685cs.AIcs.LG2024-09被引 1

用聚类生成合成图像,提升小样本下的模型表现

Feature-to-Image Data Augmentation: Improving Model Feature Extraction with Cluster-Guided Synthetic Samples

  • 先聚类后采样,在特征空间生成多样且标签一致的合成数据
  • 在有限数据下使分类准确率提升至88.63%
  • 适合医疗、低资源等数据稀缺场景的模型增强

机器学习性能依赖训练数据量,但医学与低资源领域常因数据不足导致过拟合。本文提出FICAug框架,通过k-means对原始数据进行特征空间聚类,在纯标签簇内利用高斯采样生成多样化合成特征,再通过生成神经网络投影回图像域,最终用卷积神经网络训练重构图像以提取更优表征。实验显示,仅在特征空间即达84.09%交叉验证准确率,结合ResNet-18进一步提升至88.63%,证明该方法在小样本下有效增强特征提取能力。

原文摘要 · Abstract (English)

One of the growing trends in machine learning is the use of data generation techniques, since the performance of machine learning models is dependent on the quantity of the training dataset. However, in many real-world applications, particularly in medical and low-resource domains, collecting large datasets is challenging due to resource constraints, which leads to overfitting and poor generalization. This study introduces FICAug, a novel feature-to-image data augmentation framework designed to improve model generalization under limited data conditions by generating structured synthetic samples. FICAug first operates in the feature space, where original data are clustered using the k-means algorithm. Within pure-label clusters, synthetic data are generated through Gaussian sampling to increase diversity while maintaining label consistency. These synthetic features are then projected back into the image domain using a generative neural network, and a convolutional neural network is trained on the reconstructed images to learn enhanced representations. Experimental results demonstrate that FICAug significantly improves classification accuracy. In feature space, it achieved a cross-validation accuracy of 84.09%, while training a ResNet-18 model on the reconstructed images further boosted performance to 88.63%, illustrating the effectiveness of the proposed framework in extracting new and task-relevant features.

数据增强小样本学习生成模型特征空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。