arXiv:2603.16641cs.CV2026-03中稿 · CVPR被引 2

用可组合的流模型提升零样本组合识别能力

FlowComposer: Composable Flows for Compositional Zero-Shot Learning

  • 设计可学习的特征流动路径,显式融合属性与对象信息
  • 在三个基准上实现显著提升,最高增益达7.2%
  • 适合需要强泛化能力的视觉-语言组合识别任务

组合零样本学习(CZSL)旨在通过重新组合已见属性-对象对中的基本元素来识别未见过的组合。现有基于视觉-语言模型(VLMs)的方法通常采用参数高效微调(PEFT),利用视觉解耦模块进行分解,并通过词元级提示或前缀操控编码组合。然而这类方法存在两大根本缺陷:(1)隐式组合构建,即组合仅通过词元拼接或分支式提示微调实现,缺乏嵌入空间中的显式操作;(2)残留特征纠缠,解耦不彻底导致属性、对象与组合特征相互污染。为此,本文首次系统研究流匹配在CZSL中的应用,提出FlowComposer——一种模型无关框架,学习两个基础流以将视觉特征分别迁移到属性和对象文本嵌入,再通过可学习的Composer显式融合其速度场形成组合流。为利用不可避免的残余纠缠,进一步设计泄漏引导增强方案,重用泄露特征作为辅助信号。我们在三个公开CZSL基准上评估该框架,将其作为即插即用组件集成至多种基线,均取得显著提升。

原文摘要 · Abstract (English)

Compositional zero-shot learning (CZSL) aims to recognize unseen attribute-object compositions by recombining primitives learned from seen pairs. Recent CZSL methods built on vision-language models (VLMs) typically adopt parameter-efficient fine-tuning (PEFT). They apply visual disentanglers for decomposition and manipulate token-level prompts or prefixes to encode compositions. However, such PEFT-based designs suffer from two fundamental limitations: (1) Implicit Composition Construction, where composition is realized only via token concatenation or branch-wise prompt tuning rather than an explicit operation in the embedding space; (2) Remained Feature Entanglement, where imperfect disentanglement leaves attribute, object, and composition features mutually contaminated. Together, these issues limit the generalization ability of current CZSL models. In this paper, we are the first to systematically study flow matching for CZSL and introduce FlowComposer, a model-agnostic framework that learns two primitive flows to transport visual features toward attribute and object text embeddings, and a learnable Composer that explicitly fuses their velocity fields into a composition flow. To exploit the inevitable residual entanglement, we further devise a leakage-guided augmentation scheme that reuses leaked features as auxiliary signals. We thoroughly evaluate FlowComposer on three public CZSL benchmarks by integrating it as a plug-and-play component into various baselines, consistently achieving significant improvements.

零样本学习组合识别流模型视觉语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。