arXiv:2605.12651cs.LG2026-05

用嵌入空间直接监控感知型自动驾驶系统,更准更安全。

Runtime Monitoring of Perception-Based Autonomous Systems via Embedding Temporal Logic

论文配图:Runtime Monitoring of Perception-Based Autonomous Systems via Embedding Temporal Logic
图 1 · 摘自论文原文
  • 在学习的嵌入空间中定义逻辑谓词,通过距离判断感知概念
  • 能准确监测时序组合的感知行为,与真实语义高度一致
  • 适合需要高阶感知理解的机器人操控任务

传统自主系统运行时监控依赖将连续传感器观测映射到低维状态变量的离散逻辑命题,但在以感知为核心的场景中,这种抽象需额外学习模块,常导致计算开销大、脆弱且语义错位。本文提出嵌入时空逻辑(ETL),在学习的嵌入空间中直接进行监控。ETL通过观测嵌入与参考嵌入之间的距离定义谓词,使规范可表达相似性目标或避开语义区域等高层感知概念,难以用传统谓词描述。结合时序算子,ETL自然建模时序延展和顺序性感知行为。我们设计了针对有限嵌入轨迹的ETL监控器,并引入保形校准方法,确保谓词评估可靠且面向安全。在多个操作环境中评估表明,ETL与真实语义具有强一致性,能准确监控时序复合行为。

原文摘要 · Abstract (English)

Runtime monitoring of autonomous systems traditionally relies on mapping continuous sensor observations to discrete logical propositions defined over low-dimensional state variables. This abstraction breaks down in perception-driven settings, where such mappings require additional learned modules that are often computationally expensive, brittle, and semantically misaligned. In this work, we propose Embedding Temporal Logic (ETL), a temporal logic that performs monitoring directly in learned embedding spaces. ETL defines predicates through distances between observed embeddings and target embeddings derived from reference observations. This formulation allows specifications to capture high-level perceptual concepts, such as similarity to visual goals or avoidance of semantic regions, that are difficult or impossible to express using traditional predicates. By composing these predicates with temporal operators, ETL naturally expresses temporally extended and sequential perceptual behaviors. We introduce ETL monitors for evaluating specifications over bounded embedding traces, along with a conformal calibration procedure that provides reliable and safety-oriented predicate evaluation. We evaluate our approach across multiple manipulation environments to show that ETL achieves strong empirical agreement with ground-truth semantics, including accurate monitoring of temporally composed behaviors.

运行时监控感知系统时空逻辑嵌入空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。