SECOS让模型直接从候选标签中选出最语义匹配的类别,提升开放世界半监督学习精度。
SECOS: Semantic Capture for Rigorous Classification in Open-World Semi-Supervised Learning

- 利用外部知识对齐跨模态语义,显式指导新类别学习
- 在标准设置下优于现有方法最高5.4%,无需后期匹配
- 适合需要精准标签选择的实际开放世界应用
在开放世界半监督学习(OWSSL)中,模型需从包含已知和未知类别的标注与未标注数据中学习。实际应用要求模型能直接从候选标签集中选出语义最相关的标签,实现严格分类。现有方法因缺乏对新类别的显式监督及语义信息提取机制,导致预测标签与候选文本无语义关联。为此,本文提出语义捕获框架SECOS,通过外部知识对齐多模态语义表示,为已知与未知类别提供显式监督信号,直接输出候选文本标签,无需后处理。大量实验表明,即使在宽松的后处理匹配设定下,现有方法仍被SECOS超越,最高达5.4%。代码已开源。
原文摘要 · Abstract (English)
In open-world semi-supervised learning (OWSSL), a model learns from labeled data and unlabeled data containing both known and novel classes. In practical OWSSL applications, models are expected to perform rigorous classification by directly selecting the most semantically relevant label from a candidate set for each sample. Existing OWSSL methods fail to achieve this because novel samples are trained without explicit supervision, and these methods lack mechanisms to extract latent semantic information, resulting in predicted labels that have no semantic correspondence to candidate textual labels. To address this, we introduce SEmantic Capture for Open-world Semi-supervised learning (SECOS), which directly predicts textual labels from the candidate set without post-processing, meeting the requirements of practical OWSSL applications. SECOS leverages external knowledge to extract and align semantic representations across modalities for both known and novel classes, providing explicit supervisory signals for training novel classes. Extensive experiments demonstrate that even when existing OWSSL methods are evaluated under the more lenient post-hoc matching setting, SECOS still surpasses them by up to 5.4\% without such assistance, highlighting its superior effectiveness. Code is available at https://github.com/ganchi-huanggua/OSSL-Classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。