arXiv:2608.28672cs.CVcs.LG2026-08

为自动驾驶视频流设计动态数据价值评估,提升持续学习效率。

FrameScope: Temporal Data Valuation for Stream Active Learning in Autonomous Vehicle Systems

论文配图:FrameScope: Temporal Data Valuation for Stream Active Learning in Autonomous Vehicle Systems
图 1 · 摘自论文原文
  • 基于神经正切核扩展,评估视频帧的时序价值
  • 仅选高价值帧上传标注,显著降低带宽与遗忘
  • 适合资源受限的车载实时学习系统

自动驾驶车辆在动态环境中运行,新场景和边缘案例不断出现,静态学习模型难以保障安全可靠。持续学习对适应变化至关重要,但车辆生成海量视觉数据,现有方法依赖启发式采样,忽略时序特性,易遗漏关键信息或选择冗余帧。本文提出 FrameScope,一种面向自动驾驶持续学习的时序数据价值评估框架。该框架将神经正切核理论扩展至时序领域,实现对流式视觉数据的可解释价值评估。不同于需上传全部视频的云端方法,FrameScope 在车端进行原理性帧选择,仅向云端标注服务请求高价值帧的标签。多领域迁移实验表明,FrameScope 持续优于现有方法,在样本效率和灾难性遗忘控制方面表现更优。通过本地估值、仅标注高价值帧,显著降低带宽需求,支持轻量级云端标注服务下的可扩展运行。

原文摘要 · Abstract (English)

Autonomous vehicles operate in dynamic, ever-changing environments where new scenarios and edge cases constantly emerge. As a result, static learning models are inadequate for ensuring safe and reliable operation. Continuous learning is essential for adapting to these evolving conditions and maintaining robust performance across diverse real-world settings. However, autonomous vehicles generate massive streams of visual data during operation, and existing continuous learning approaches typically rely on heuristic sampling methods that fail to capture temporal dynamics, often overlooking critical learning opportunities or selecting redundant frames. In this paper, we introduce FrameScope, a temporal data valuation framework for continuous learning in autonomous vehicles. FrameScope extends neural tangent kernel theory to temporal domains, enabling principled valuation of streaming visual data. Unlike cloud-centric methods that transmit all video data for processing, our approach performs principled, local frame selection on the vehicle and queries a cloud-based oracle model only for labels of those high-value frames. Extensive experiments across multiple domain shifts show that FrameScope consistently outperforms existing methods, achieving higher sample efficiency and significantly reducing catastrophic forgetting in autonomous vehicle perception. By valuing data on the vehicle and querying only labels for selected frames, FrameScope reduces bandwidth requirements, enabling scalable operation with a lightweight cloud labeling service.

持续学习数据估值自动驾驶边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。