车载系统自适应异常检测,结合强化学习与人工反馈,持续保持高精度。
Self-Adaptive Anomaly Detection with Reinforcement Learning and Human Feedback in Connected Vehicles

- 用注意力机制动态选择最优检测器,利用微服务间依赖关系
- 三重统计漂移检测器一致报警才触发,提升检测精确率
- 支持人工干预重训练,避免遗忘旧知识,适合运维人员使用
联网车辆是自主的网络物理系统,需在运行中持续监控以在故障传播前发现异常行为。由于系统不断演化(如远程更新、配置变更、负载变化),正常行为定义随之改变,导致静态诊断方法无声退化。现有方法通常孤立处理模型自适应或人工介入,而非协同监督。本文提出一种在线异常检测框架,集成三项协同机制:基于自注意力的因子化深度Q网络从候选池中为每个服务选择最适检测器,利用微服务拓扑中的依赖关系;由三个统计漂移检测器组成的集成模型仅当三者一致时报警,优先保障精确率;基于待定转换缓冲区和60/40优先重放策略的人工介入重训练机制,使操作员可融入专家知识同时保留对先前数据分布的学习。在运行自动代客泊车应用的七个后端微服务测试平台上评估,注意力增强代理的F1得分为0.69,远高于任一单一检测器的最高0.11。在一次引起明显概念漂移的真实软件更新后,F1降至0.52;经人工触发重训练后,新分布上性能恢复至0.65,旧分布上仍保持0.69,证明系统具备持续适应能力且无灾难性遗忘。
原文摘要 · Abstract (English)
Connected vehicles are autonomous cyber-physical systems whose behavior must be continuously monitored during operation to detect deviations from normal operation before they propagate into failures. Such evaluation is challenging because the systems themselves evolve: over-the-air updates, configuration changes, and shifting workloads alter the definition of normal behavior, causing static diagnostic methods to degrade silently over time. Existing approaches typically address either automated model adaptation or operator integration in isolation, rather than as a single coordinated supervisory loop. This paper presents an online anomaly detection framework for autonomous CPS that integrates three coordinated mechanisms. A factorized deep Q-network with self-attention selects the most suitable detector from a candidate pool for each monitored service, exploiting inter-service dependencies in the microservice topology. An ensemble of three statistical drift detectors monitors the input distribution and raises an alarm only when all three concur, prioritizing precision over recall. A human-in-the-loop retraining mechanism, built around a pending transition buffer and a 60/40 prioritized replay strategy, allows the operator to incorporate expert knowledge while preserving the system's learned response to prior data distributions. The framework is evaluated on a connected-vehicle testbed running an automated valet parking application across seven backend microservices. The attention-augmented agent achieves an F1 score of 0.69, compared to at most 0.11 for any single detector applied uniformly. Following a real software update that induces measurable concept drift, F1 drops to 0.52; after operator-triggered retraining, performance recovers to 0.65 on the new distribution while remaining at 0.69 on the prior one, demonstrating sustained adaptation without catastrophic forgetting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。