arXiv:2604.24935cs.CRcs.LG2026-04中稿 · the 35th Internati…被引 1

首个将车载CAN通信分析转为问答任务的基准,助力智能汽车安全推理。

CAN-QA: A Question-Answering Benchmark for Reasoning over In-Vehicle CAN Traffic

论文配图:CAN-QA: A Question-Answering Benchmark for Reasoning over In-Vehicle CAN Traffic
图 1 · 摘自论文原文
  • 把CAN日志转为带时间分段的问答对,用规则模板生成自然语言问题和答案。
  • 构建了33,128个跨10类语义与时间属性的问答数据,覆盖多种交通行为特征。
  • 揭示大模型在时序推理和多条件判断上存在明显短板,适合安全研究者参考。

控制器局域网络(CAN)是车辆中关键的安全通信协议,但缺乏内置安全机制,因此入侵检测至关重要。现有方法大多将CAN入侵检测视为分类任务,将复杂的流量模式映射到攻击标签,这忽略了流量的时间与关系结构,且与实际取证流程脱节。为此,我们提出CAN-QA,首个将CAN流量分析重构为问答(QA)任务的基准。CAN-QA将原始CAN日志转换为时间分段窗口,并使用确定性规则模板生成自然语言问题与自动推导的真值答案。该数据集包含33,128个问答对,涵盖10个类别,分别针对CAN流量的不同语义与时间属性。利用CAN-QA,我们在真假题与多选题格式下评估了大型语言模型。结果表明,尽管这些模型能捕捉表面统计规律,但在时序推理、多条件推断及高层行为理解方面表现不佳。代码已开源:https://github.com/Kriiiiss/CAN-QA。

原文摘要 · Abstract (English)

The Controller Area Network (CAN) is a safety-critical in-vehicle communication protocol that lacks built-in security mechanisms, making intrusion detection essential. Existing approaches predominantly formulate CAN intrusion detection as a classification task, mapping complex traffic patterns to attack labels. However, this formulation abstracts away the temporal and relational structure of CAN traffic and misaligns with real-world forensic workflows, which require systematic reasoning about traffic behavior. To address this gap, we introduce CAN-QA, the first benchmark that reformulates CAN traffic analysis as a question-answering (QA) task. CAN-QA converts raw CAN logs into temporally segmented windows and applies deterministic rule-based templates to generate natural-language questions paired with automatically derived ground-truth answers. The resulting dataset comprises 33,128 QA pairs across 10 categories, each targeting distinct semantic and temporal properties of CAN traffic. Using CAN-QA, we evaluate large language models across both True/False and multiple-choice formats. Our results indicate that, although these models capture superficial statistical regularities, they struggle with temporal reasoning, multi-condition inference, and higher-level behavioral interpretation. Our code is available at https://github.com/Kriiiiss/CAN-QA.

车联网安全检测问答系统大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。