arXiv:2507.21460cs.CV2025-07被引 1

提出新光场表示与网络,提升暗光下目标跟踪精度

An Angular-Temporal Interaction Network for Light Field Object Tracking in Low-Light Scenes

  • 设计新型光场张量结构,显式建模角度几何关系
  • 在低光照场景下实现超越现有方法的单目标跟踪性能
  • 支持自监督优化,适合复杂光照下的多目标跟踪应用

高质量4D光场表征对场景感知至关重要,因其可提供区分性的空间-角度线索以识别运动目标。然而,现有方法在时间域中仍难以实现可靠的角特征建模,尤其在复杂低光照场景下表现不佳。本文提出一种新型光场子午面图像(ESI)表示,显式定义光场内的几何结构。利用子午面上光线角度的突变特性,该表示可增强暗光场景下的视觉表达并降低高维光场冗余。进一步提出角-时交互网络(ATINet),从光场的几何结构线索和角-时交互线索中学习角感知表征,并可自监督优化以增强时间域中的几何特征交互。最后,构建大规模光场低光照目标跟踪数据集。大量实验表明,ATINet在单目标跟踪上达到当前最优性能;扩展至多目标跟踪也验证了高质量光场角-时建模的有效性。

原文摘要 · Abstract (English)

High-quality 4D light field representation with efficient angular feature modeling is crucial for scene perception, as it can provide discriminative spatial-angular cues to identify moving targets. However, recent developments still struggle to deliver reliable angular modeling in the temporal domain, particularly in complex low-light scenes. In this paper, we propose a novel light field epipolar-plane structure image (ESI) representation that explicitly defines the geometric structure within the light field. By capitalizing on the abrupt changes in the angles of light rays within the epipolar plane, this representation can enhance visual expression in low-light scenes and reduce redundancy in high-dimensional light fields. We further propose an angular-temporal interaction network (ATINet) for light field object tracking that learns angular-aware representations from the geometric structural cues and angular-temporal interaction cues of light fields. Furthermore, ATINet can also be optimized in a self-supervised manner to enhance the geometric feature interaction across the temporal domain. Finally, we introduce a large-scale light field low-light dataset for object tracking. Extensive experimentation demonstrates that ATINet achieves state-of-the-art performance in single object tracking. Furthermore, we extend the proposed method to multiple object tracking, which also shows the effectiveness of high-quality light field angular-temporal modeling.

光场追踪暗光成像角时交互自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。