用动态均值漂移算法实时识别车载数据中的罕见场景,提升数据多样性。
A Data-Driven Novelty Score for Diverse In-Vehicle Data Recording
- 基于均值与协方差统计建模正常内容,动态计算每帧新颖性得分。
- 减少冗余数据后模型性能提升,冗余越高越需激进过滤。
- 支持32帧/秒实时处理,适合持续采集的自动驾驶数据系统。
高质量数据集对自动驾驶感知系统训练至关重要,但真实世界数据常偏向常见场景,导致罕见事件被忽略,影响模型泛化能力与安全性。核心问题是罕见性困境:新事件出现频率低,传统日志记录无法有效捕捉,造成大量冗余数据堆积而关键案例被稀释。本文提出一种面向对象级新颖性检测的实时数据选择方法,利用新型动态均值漂移算法为图像帧分配数据驱动的新颖性得分,通过建模正常内容的均值与协方差统计来识别含新对象的帧,并剔除冗余内容。结果表明,采用该方法压缩训练集可提升模型性能,冗余度越高,越需要且越适合激进过滤;随机采样虽有收益,但易引发过拟合与结果不可预测。所提方法支持32帧/秒实时部署,且随时间稳定运行,通过持续更新正常定义,实现对连续数据流中新奇事件的高效检测。
原文摘要 · Abstract (English)
High-quality datasets are essential for training robust perception systems in autonomous driving. However, real-world data collection is often biased toward common scenes and objects, leaving novel cases underrepresented. This imbalance hinders model generalization and compromises safety. The core issue is the curse of rarity. Over time, novel events occur infrequently, and standard logging methods fail to capture them effectively. As a result, large volumes of redundant data are stored, while critical novel cases are diluted, leading to biased datasets. This work presents a real-time data selection method focused on object-level novelty detection to build more balanced and diverse datasets. The method assigns a data-driven novelty score to image frames using a novel dynamic Mean Shift algorithm. It models normal content based on mean and covariance statistics to identify frames with novel objects, discarding those with redundant elements. The main findings show that reducing the training dataset size with this method can improve model performance, whereas higher redundancy tends to degrade it. Moreover, as data redundancy increases, more aggressive filtering becomes both possible and beneficial. While random sampling can offer some gains, it often leads to overfitting and unpredictability in outcomes. The proposed method supports real-time deployment with 32 frames per second and is constant over time. By continuously updating the definition of normal content, it enables efficient detection of novelties in a continuous data stream.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。