arXiv:2605.06906cs.LG2026-05

提出统一框架TraXion,让交通、安全、医疗等事件流数据共享预训练模型。

TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond

  • 基于三类结构特性设计新预训练目标,突破传统文本类方法局限。
  • 单个模型在6个出行数据集上全任务超越基线,跨域表现优异。
  • 适用于移动轨迹、认证日志、重症监护等多领域事件流建模。

人类移动行为在三个结构层面区别于文本和通用时间序列:访问是位置、时间与活动联合分布的元组事件;用户具有跨轨迹的持久特征;不同用户在共享地点的共现是关键信号。现有移动预训练方法沿用语言建模范式,将轨迹视为句子、访问视为词,难以满足上述三类特性。这些特性共同定义了更广泛的多主体时空事件流(MESES)类别,涵盖企业认证日志、电子健康记录等依赖共享设施或情境的领域。本文提出三则公理化准则,确保任何针对MESES的预训练框架都需满足,并设计了全新架构TraXion,其目标与结构协同满足该准则。一个数据集对应的TraXion检查点,在六个公开移动数据集上的异常检测、下一个兴趣点推荐、下一次访问预测及社交关系预测任务中均优于特定任务基线。该方案未作调整地应用于企业认证日志与ICU死亡率预测,性能持平或超越已有工作,证明移动、安全、医疗等异构事件流可由统一框架建模。

原文摘要 · Abstract (English)

Human mobility differs from text and from generic time series in three structural ways: visits are tuple-valued events whose meaning depends on the joint distribution over location, time, and activity; users carry persistent signatures across trajectories; and visits are not independent across users, since co-location at shared places is a primary signal. Existing pre-training recipes for mobility import objectives from language modeling, treating trajectories as sentences and visits as tokens, an analogy that fails against each of the three properties above. These properties define a broader class, multi-entity spatiotemporal event streams (MESES), spanning enterprise authentication logs, electronic health records, and other event-stream domains where entities share infrastructure, schedules, or contexts. We make the properties precise as three axioms that any pre-training framework for MESES should satisfy, and introduce TraXion, whose objectives and architecture are jointly designed to meet them. A single TraXion checkpoint per dataset beats task-specific baselines on every task across six public mobility datasets covering anomaly detection, next-POI recommendation, next-visit prediction, and social-link prediction. The same recipe, applied unchanged to enterprise authentication logs and ICU mortality prediction, matches or exceeds prior work on both, showing that event streams from domains as different as mobility, security, and healthcare can be modeled under a single framework.

预训练事件流多模态跨域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。