解决多视图缺失与类别增量共存的高效学习难题。
E2PL: Effective and Efficient Prompt Learning for Incomplete Multi-view Multi-Label Class Incremental Learning
- 设计任务定制与缺失感知双提示机制,灵活应对视图缺失和新类加入。
- 提出原型张量化模块,将参数量从指数级降至线性增长。
- 适合大规模动态数据场景,尤其对资源受限的在线系统有实用价值。
多视图多标签分类在整合多元信息的现代网络应用中至关重要。然而,真实网络环境普遍存在视图缺失与持续新增类别,严重制约模型鲁棒性。现有方法或无法适应新类别,或在处理所有可能的缺失模式时导致参数量呈指数增长,难以扩展。为此,我们首次提出新任务——不完整多视图多标签类别增量学习(IMvMLCIL),要求模型同时应对异构缺失视图与动态类别扩展。我们提出E2PL框架,融合两类新颖提示:面向类别增量的定制提示与面向缺失场景的感知提示。为根本解决缺失提示的指数参数爆炸问题,我们设计高效原型张量化模块,通过原子张量分解将提示参数复杂度从指数级降至线性。进一步引入动态对比学习策略,显式建模多种缺失模式间的复杂依赖关系,增强模型鲁棒性。在三个基准上的大量实验表明,E2PL在效果与效率上均显著优于当前最优方法。代码与数据集已公开。
原文摘要 · Abstract (English)
Multi-view multi-label classification (MvMLC) is indispensable for modern web applications aggregating information from diverse sources. However, real-world web-scale settings are rife with missing views and continuously emerging classes, which pose significant obstacles to robust learning. Prevailing methods are ill-equipped for this reality, as they either lack adaptability to new classes or incur exponential parameter growth when handling all possible missing-view patterns, severely limiting their scalability in web environments. To systematically address this gap, we formally introduce a novel task, termed \emph{incomplete multi-view multi-label class incremental learning} (IMvMLCIL), which requires models to simultaneously address heterogeneous missing views and dynamic class expansion. To tackle this task, we propose \textsf{E2PL}, an Effective and Efficient Prompt Learning framework for IMvMLCIL. \textsf{E2PL} unifies two novel prompt designs: \emph{task-tailored prompts} for class-incremental adaptation and \emph{missing-aware prompts} for the flexible integration of arbitrary view-missing scenarios. To fundamentally address the exponential parameter explosion inherent in missing-aware prompts, we devise an \emph{efficient prototype tensorization} module, which leverages atomic tensor decomposition to elegantly reduce the prompt parameter complexity from exponential to linear w.r.t. the number of views. We further incorporate a \emph{dynamic contrastive learning} strategy explicitly model the complex dependencies among diverse missing-view patterns, thus enhancing the model's robustness. Extensive experiments on three benchmarks demonstrate that \textsf{E2PL} consistently outperforms state-of-the-art methods in both effectiveness and efficiency. The codes and datasets are available at https://anonymous.4open.science/r/code-for-E2PL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。