arXiv:2608.13938cs.CV2026-08

用坐标感知的令牌空间实现高效视频神经表示,无需每视频优化。

CoANeRV: Coordinate-Aware Token-Space Neural Video Representation

论文配图:CoANeRV: Coordinate-Aware Token-Space Neural Video Representation
图 1 · 摘自论文原文
  • 通过前向传播生成紧凑视频令牌,共享解码器处理时空查询。
  • 在多个数据集上重建质量优于现有方法,峰值内存降低30%以上。
  • 适合需要快速编码、高分辨率视频重建的应用场景。

视频的神经表示(NeRV)通过将视频特定信息存储在网络权重中,展现出强大的重建保真度。然而,现有方法通常需要昂贵的每视频优化或视频专属权重生成,难以实现高效的近似视频表示。我们提出 CoANeRV,一种坐标感知的令牌空间框架,将更广泛的令牌条件神经场范式应用于近似视频表示。CoANeRV 在一次前向传播中形成紧凑视频令牌,并使用共享的坐标条件解码器重建连续时空查询,避免了每视频解码器优化或生成,同时保留了坐标级重建灵活性。为提升令牌空间重建效果,CoANeRV 引入坐标感知解码架构,通过轴自适应位置编码和温度调制交叉注意力,对齐时空查询与视频令牌。块级坐标查询进一步降低了峰值注意力内存,使高分辨率重建成为可能。在多样化视频数据集上的实验表明,CoANeRV 持续优于先前的前馈 NeRV 和 INR 基线,在重建质量上提升显著,峰值内存低于基于注意力的坐标解码器,且无需每视频优化即可实现高效近似编码。这些结果支持所提出的视频特定组合:前馈令牌生成、时空坐标检索与内存受限密集查询。代码已开源:https://github.com/jialong2023/CoANeRV。

原文摘要 · Abstract (English)

Neural representations for videos (NeRV) have shown strong reconstruction fidelity by storing video-specific information in network weights. However, existing formulations typically require either costly per-video optimization or video-specific weight generation, making it difficult to scale to efficient amortized video representation. We propose CoANeRV, a coordinate-aware token-space framework that adapts the broader token-conditioned neural-field paradigm to amortized video representation. CoANeRV forms compact video tokens in one feed-forward pass and uses a shared coordinate-conditioned decoder to reconstruct continuous spatio-temporal queries, avoiding per-video decoder optimization or generation while retaining coordinate-level reconstruction flexibility. To make token-space reconstruction effective, CoANeRV introduces a coordinate-aware decoding architecture that aligns spatio-temporal queries with video tokens through axis-adaptive positional encoding and temperature-modulated cross-attention. Block-wise coordinate querying further reduces peak attention memory, making high-resolution reconstruction practical. Experiments on diverse video datasets show that CoANeRV consistently improves reconstruction quality over prior feed-forward NeRV and INR baselines, reduces peak memory compared with attention-based coordinate decoders, and provides efficient amortized encoding without per-video optimization. These results support the proposed video-specific combination of feed-forward token formation, spatio-temporal coordinate retrieval, and memory-bounded dense querying. The code is available at https://github.com/jialong2023/CoANeRV.

视频生成神经表示令牌空间高效编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。