arXiv:2609.04948cs.CVcs.AI2026-09

通过一致性对齐提升长尾视觉识别,效果优于传统多样性方法。

VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition

论文配图:VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition
图 1 · 摘自论文原文
  • 用局部一致性学习减少预测方差,避免依赖不稳定的高频信息。
  • 通过低分辨率特征对齐实现专家间语义一致,提升尾部类别性能。
  • 适用于长尾数据集上的分类任务,尤其适合关注小样本类别的研究者。

多专家模型已成为长尾学习的主流范式,通常归因于其专家多样性带来的优势。然而,我们重新审视这一核心假设,发现仅通过逻辑调整或显式正则化产生的多样性并不能保证更高的集成准确率。本工作表明,多专家模型的实际收益更多来自方差降低而非多样性最大化。为此,我们提出VICAL(邻域一致性对齐)框架,不强调专家多样性,而是通过减少预测方差来提升长尾识别性能。该方法包含两个关键组件:自一致性学习与深度集成蒸馏。自一致性学习抑制对不稳定高频信息的依赖,平滑局部损失景观,缓解过拟合,尤其改善尾部类别表现;深度集成蒸馏利用低分辨率视角促进专家间的低频语义一致性,规避与已有知识的优化冲突。在CIFAR-LT、ImageNet-LT和iNaturalist 2018上的大量实验表明,VICAL持续优于当前最优方法,验证了以一致性为导向设计的有效性。代码已公开于https://github.com/FlamieZhu/Vicinal-Consistency-Alignment。

原文摘要 · Abstract (English)

Multi-expert models have become the dominant paradigm for long-tailed learning, largely attributed to their presumed ability to benefit from expert diversity. However, we revisit this central assumption and reveal that diversity induced by logit adjustment or explicit regularizers does not guarantee better ensemble accuracy. Our work suggests that multi-expert models benefit more from variance reduction than diversity maximization. We introduce \textbf{VICAL}, a \textbf{VI}cinal \textbf{C}onsistency \textbf{AL}ignment framework that improves long-tailed recognition not by enforcing expert diversity, but by reducing prediction variance. Specifically, our approach comprises two key components: Self-Consistency Learning and Deep Ensemble Distillation. Self-Consistency Learning discourages reliance on unstable high-frequency information, smoothing the local loss landscape and mitigating overfitting, especially for tail classes. Deep Ensemble Distillation promotes cross-expert low-frequency semantic agreement using a low-resolution view, thereby sidestepping optimization conflicts with established knowledge. Extensive experiments on CIFAR-LT, ImageNet-LT, and iNaturalist 2018 show that VICAL consistently outperforms state-of-the-art methods, validating the effectiveness of our consistency-driven design. Our code is available at \href{https://github.com/FlamieZhu/Vicinal-Consistency-Alignment}{VICAL}.

长尾识别一致性对齐多专家模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。