arXiv:2503.15420cs.LGcs.CV2025-03ICCV被引 4

统一编码多任务数据,用隐式函数提升效率与表达力

LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encoding

  • 用并行局部隐函数+分层潜在生成器捕捉多尺度特征
  • 在生成与分类任务中达最优性能,计算成本显著降低
  • 适合需要高效通用编码的多模态信号建模场景

隐式神经表示(INRs)在统一跨数据域任务建模方面展现出强大潜力,具备内存效率高和分辨率无关等优势。传统深度学习模型通常依赖特定模态,需为不同信号定制架构与目标。现有INR框架常依赖全局潜在向量或存在计算效率问题,限制了广泛应用。我们提出LIFT,一种高性能新框架,通过元学习捕捉多尺度信息。LIFT结合多个并行局部隐函数与分层潜在生成器,生成涵盖局部、中间与全局特征的统一潜在表示,实现局部区域间平滑过渡,增强表达能力的同时保持推理效率。此外,我们引入ReLIFT,其包含残差连接和强表达频率编码,有效缓解同类方法中的收敛-容量差距,提供高效且强大的解决方案。实验表明,LIFT在生成建模与分类任务中达到当前最佳性能,计算成本显著下降。在单任务设置下,精简版ReLIFT在信号表示与反问题任务中表现优异。

原文摘要 · Abstract (English)

Implicit Neural Representations (INRs) are proving to be a powerful paradigm in unifying task modeling across diverse data domains, offering key advantages such as memory efficiency and resolution independence. Conventional deep learning models are typically modality-dependent, often requiring custom architectures and objectives for different types of signals. However, existing INR frameworks frequently rely on global latent vectors or exhibit computational inefficiencies that limit their broader applicability. We introduce LIFT, a novel, high-performance framework that addresses these challenges by capturing multiscale information through meta-learning. LIFT leverages multiple parallel localized implicit functions alongside a hierarchical latent generator to produce unified latent representations that span local, intermediate, and global features. This architecture facilitates smooth transitions across local regions, enhancing expressivity while maintaining inference efficiency. Additionally, we introduce ReLIFT, an enhanced variant of LIFT that incorporates residual connections and expressive frequency encodings. With this straightforward approach, ReLIFT effectively addresses the convergence-capacity gap found in comparable methods, providing an efficient yet powerful solution to improve capacity and speed up convergence. Empirical results show that LIFT achieves state-of-the-art (SOTA) performance in generative modeling and classification tasks, with notable reductions in computational costs. Moreover, in single-task settings, the streamlined ReLIFT architecture proves effective in signal representations and inverse problem tasks.

隐式表示多任务建模高效编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。