arXiv:2409.19659cs.CV2024-09NeurIPS被引 11

动态对齐师生注意力,提升开放世界类别发现性能

Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery

  • 设计可动态更新的教师,根据学生反馈调整注意力
  • 在多个基准上超越现有方法,新类识别准确率显著提升
  • 适合开放世界场景下的无监督类别发现研究者

近期进展表明,传统半监督学习策略可应用于广义类别发现(GCD)任务。通常采用教师-学生框架,由教师向学生传授知识以分类,即使没有明确标签。然而,GCD面临独特挑战,尤其是新类别缺乏先验信息,导致教师误导和师生学习不同步,最终影响性能。本文深入分析传统教师-学生设计在开放世界中失败的原因,发现注意力层间模式学习不一致是核心问题。为此提出FlipClass方法,通过动态更新教师注意力以匹配学生表现,基于能量视角实现师生注意力对齐,促进旧类与新类的一致性识别与同步学习。大量实验表明,FlipClass显著优于现有GCD方法,树立了新基准。

原文摘要 · Abstract (English)

Recent advancements have shown promise in applying traditional Semi-Supervised Learning strategies to the task of Generalized Category Discovery (GCD). Typically, this involves a teacher-student framework in which the teacher imparts knowledge to the student to classify categories, even in the absence of explicit labels. Nevertheless, GCD presents unique challenges, particularly the absence of priors for new classes, which can lead to the teacher's misguidance and unsynchronized learning with the student, culminating in suboptimal outcomes. In our work, we delve into why traditional teacher-student designs falter in open-world generalized category discovery as compared to their success in closed-world semi-supervised learning. We identify inconsistent pattern learning across attention layers as the crux of this issue and introduce FlipClass, a method that dynamically updates the teacher to align with the student's attention, instead of maintaining a static teacher reference. Our teacher-student attention alignment strategy refines the teacher's focus based on student feedback from an energy perspective, promoting consistent pattern recognition and synchronized learning across old and new classes. Extensive experiments on a spectrum of benchmarks affirm that FlipClass significantly surpasses contemporary GCD methods, establishing new standards for the field.

类别发现师生模型注意力对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。