针对稀有样本识别难题,提出新框架提升罕见类召回率。
ScarceGAN: Discriminative Classification Framework for Rare Class Identification for Longitudinal Data with Weak Prior
- 用弱标签多类负样本重构半监督GAN,引入容错机制应对标签噪声。
- 在KDDCUP99数据集上对0.09%的稀有攻击类实现超85%召回率。
- 适合处理标签极少、负类复杂且未知行为频发的长时序数据场景。
本文提出ScarceGAN,用于从具有少量弱标签先验的多维纵向遥测数据中识别极端稀有的样本。针对正类严重稀缺(源于数据本身偏斜及标签极度有限)、负类多类别且分布不均、特征部分重叠,以及大量未标记数据导致正负类先验微弱、未知行为可能存在于负类等问题,提出新方法。尽管与PU学习相关,但认为可利用对负类的不完全知识,通过半监督方式更好学习其补集(即正类)。ScarceGAN重构半监督GAN,兼容弱标签多类负样本和可用正样本,通过在判别器中引入‘容错’项放松对负样本精确区分的约束。修改了判别器在监督与无监督路径下的损失函数,以及生成器目标。应用于技能游戏中的高风险玩家识别,该方法在稀有类上实现超过85%的召回率(较传统半监督GAN提升约60%),且在未知空间中保持极低冗余。进一步优于近期基于GAN的专用模型,在识别KDDCUP99入侵数据集中0.09%的罕见攻击类时建立新基准。
原文摘要 · Abstract (English)
This paper introduces ScarceGAN which focuses on identification of extremely rare or scarce samples from multi-dimensional longitudinal telemetry data with small and weak label prior. We specifically address: (i) severe scarcity in positive class, stemming from both underlying organic skew in the data, as well as extremely limited labels; (ii) multi-class nature of the negative samples, with uneven density distributions and partially overlapping feature distributions; and (iii) massively unlabelled data leading to tiny and weak prior on both positive and negative classes, and possibility of unseen or unknown behavior in the unlabelled set, especially in the negative class. Although related to PU learning problems, we contend that knowledge (or lack of it) on the negative class can be leveraged to learn the compliment of it (i.e., the positive class) better in a semi-supervised manner. To this effect, ScarceGAN re-formulates semi-supervised GAN by accommodating weakly labelled multi-class negative samples and the available positive samples. It relaxes the supervised discriminator's constraint on exact differentiation between negative samples by introducing a 'leeway' term for samples with noisy prior. We propose modifications to the cost objectives of discriminator, in supervised and unsupervised path as well as that of the generator. For identifying risky players in skill gaming, this formulation in whole gives us a recall of over 85% (~60% jump over vanilla semi-supervised GAN) on our scarce class with very minimal verbosity in the unknown space. Further ScarceGAN outperforms the recall benchmarks established by recent GAN based specialized models for the positive imbalanced class identification and establishes a new benchmark in identifying one of rare attack classes (0.09%) in the intrusion dataset from the KDDCUP99 challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。