提出新型连续张量函数表示法,有效缓解离散化误差
Neural Operator-Grounded Continuous Tensor Function Representation and Its Applications
- 用神经算子替代传统离散线性模式乘积,实现连续非线性映射
- 在多类数据上完成数据补全任务,性能优于经典方法
- 适合处理网格与非网格数据,尤其适用于复杂真实世界数据
连续张量函数近年来受到关注,因其可统一表示网格及非网格数据。然而,由于传统模式-n乘积本质上是离散且线性的,现有连续张量表示的潜力受限。为此,本文提出基于神经算子的模式-n算子,作为离散线性模式乘积的连续非线性替代方案。新算子直接将连续核心张量函数映射到连续目标张量函数,提供对真实世界数据的真实连续表示,并可缓解离散化伪影。在此基础上,提出神经算子接地的连续张量函数表示(NO-CTR),相比经典离散张量表示和现有连续张量函数表示,能更忠实刻画复杂真实数据。理论上证明任意连续张量函数均可被NO-CTR逼近。为验证能力,设计基于NO-CTR的多维数据补全模型。在多光谱图像、彩色视频、不同分辨率的Sentinel-2图像以及点云等各类数据上进行大量实验,结果表明其性能显著优越。
原文摘要 · Abstract (English)
Recently, continuous tensor functions have attracted increasing attention, because they can unifiedly represent data both on mesh grids and beyond mesh grids. However, since mode-$n$ product is essentially discrete and linear, the potential of current continuous tensor function representations is still locked. To break this bottleneck, we suggest neural operator-grounded mode-$n$ operators as a continuous and nonlinear alternative of discrete and linear mode-$n$ product. Instead of mapping the discrete core tensor to the discrete target tensor, proposed mode-$n$ operator directly maps the continuous core tensor function to the continuous target tensor function, which provides a genuine continuous representation of real-world data and can ameliorate discretization artifacts. Empowering with continuous and nonlinear mode-$n$ operators, we propose a neural operator-grounded continuous tensor function representation (abbreviated as NO-CTR), which can more faithfully represent complex real-world data compared with classic discrete tensor representations and continuous tensor function representations. Theoretically, we also prove that any continuous tensor function can be approximated by NO-CTR. To examine the capability of NO-CTR, we suggest an NO-CTR-based multi-dimensional data completion model. Extensive experiments across various data on regular mesh grids (multi-spectral images and color videos), on mesh girds with different resolutions (Sentinel-2 images) and beyond mesh grids (point clouds) demonstrate the superiority of NO-CTR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。