用傅里叶变换增强细粒度分类,更好发现未知类别。
Fourier Self-Supervision for Fine-Grained Generalized Category Discovery

- 通过高低频滤波分离抽象特征与细节纹理,提升特征表达
- 在多个细粒度数据集上超越现有方法,未知类别数下仍有效
- 适合需要细粒度识别与新类发现的任务场景
广义类别发现旨在识别已知类别并从无标签数据中发现新类别。现有方法多基于自监督和对比学习,常难以捕捉细微差别,依赖表面视觉线索而非人类用于分类的内在属性。本文提出傅里叶自监督,利用图像的傅里叶变换增强微小差异的辨别能力,支持新类发现。方法采用双频滤波策略:低通滤波提取抽象属性以捕获高层类别信息,高通滤波强调边缘、纹理等细节,对细粒度识别至关重要。两者在独立潜在空间中运作,其重叠表示共同构建更丰富完整的特征空间。该双频机制不仅优化了新类识别,还增强了模型在细粒度类别发现中的判别力。多个细粒度数据集上的实验表明,引入傅里叶自监督的方法优于当前最佳方案,即使类别数量未知也表现优异,验证了其在广义类别发现任务中的有效性。代码已开源:https://github.com/SarahRastegar/FourEx。
原文摘要 · Abstract (English)
Generalized Category Discovery aims to recognize known categories while identifying novel ones within unlabeled data. Existing methods, typically based on self-supervision and contrastive learning, often struggle to capture fine-grained distinctions, relying on superficial visual cues rather than the intrinsic attributes humans use for categorization. We introduce Fourier Self-Supervision, that leverages the Fourier transform of images to enhance the discrimination of subtle differences and support the discovery of new categories. Our method employs a dual frequency filtering strategy: a low-pass filter first extracts broad, abstract attributes that capture high-level category information, while a high-pass filter emphasizes fine details such as edges and textures that are essential for fine-grained recognition. Each operates on a dedicated latent space, and their overlapping representations together yield a richer, more complete feature space. This dual-frequency approach not only refines feature extraction to identify novel categories, but also strengthens the model's discriminative power in fine-grained category discovery. Experiments on multiple fine-grained datasets show that incorporating Fourier Self-Supervision outperforms state-of-the-art methods, even when the number of classes is unknown, demonstrating its effectiveness for Generalized Category Discovery. Our code is available at: https://github.com/SarahRastegar/FourEx.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。