arXiv:2601.03056cs.CV2026-01AAAI被引 1

通过结构化概念与特征空间,提升细粒度模型在分布偏移下的泛化能力。

Fine-Grained Generalization via Structuralizing Concept and Feature Space into Commonality, Specificity and Confounding

  • 将概念和特征空间拆分为共性、特异性和混淆三部分,实现精细化建模。
  • 在三个基准数据集上平均性能提升9.87%,优于现有最优方法3.08%。
  • 适用于细粒度识别任务,尤其适合需要可解释性的场景。

细粒度领域泛化(FGDG)因类别间差异细微、类内变化显著而更具挑战性。在领域偏移下,模型对细粒度线索过度敏感,导致关键特征被抑制,性能大幅下降。认知研究表明,人类通过利用共性与特异性属性进行分类,能准确区分细粒度类别。当前深度学习模型尚未有效模拟此机制。受此启发,我们提出概念-特征结构化泛化(CFSG),显式将概念与特征空间分解为共性、特异性与混淆三部分。为应对不同程度的分布偏移,引入自适应机制动态调整三部分比例,并在最终预测中为每对成分分配显式权重。在三个单源基准数据集上的大量实验表明,CFSG相比基线模型平均提升9.87%,优于现有最先进方法平均3.08%。可解释性分析验证了多粒度结构化知识的有效融合,且特征结构化促进了概念结构化的形成。

原文摘要 · Abstract (English)

Fine-Grained Domain Generalization (FGDG) presents greater challenges than conventional domain generalization due to the subtle inter-class differences and relatively pronounced intra-class variations inherent in fine-grained recognition tasks. Under domain shifts, the model becomes overly sensitive to fine-grained cues, leading to the suppression of critical features and a significant drop in performance. Cognitive studies suggest that humans classify objects by leveraging both common and specific attributes, enabling accurate differentiation between fine-grained categories. However, current deep learning models have yet to incorporate this mechanism effectively. Inspired by this mechanism, we propose Concept-Feature Structuralized Generalization (CFSG). This model explicitly disentangles both the concept and feature spaces into three structured components: common, specific, and confounding segments. To mitigate the adverse effects of varying degrees of distribution shift, we introduce an adaptive mechanism that dynamically adjusts the proportions of common, specific, and confounding components. In the final prediction, explicit weights are assigned to each pair of components. Extensive experiments on three single-source benchmark datasets demonstrate that CFSG achieves an average performance improvement of 9.87% over baseline models and outperforms existing state-of-the-art methods by an average of 3.08%. Additionally, explainability analysis validates that CFSG effectively integrates multi-granularity structured knowledge and confirms that feature structuralization facilitates the emergence of concept structuralization.

细粒度识别领域泛化可解释性结构化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。