arXiv:2608.13741cs.CLcs.LG2026-08

让文本和时序数据对齐,生成更精准的时序序列。

GALA: Generation-Aware Cross-Modal Alignment for Text-to-Time-Series Synthesis

论文配图:GALA: Generation-Aware Cross-Modal Alignment for Text-to-Time-Series Synthesis
图 1 · 摘自论文原文
  • 先对齐文本与时序模型的嵌入空间,再用对齐结果指导生成。
  • 在4个领域、3种长度上36项指标中30项领先,平均排名1.08~1.42。
  • 打破生成质量与文本匹配间的权衡,适合需要高精度控制的场景。

从自然语言生成时序数据正成为最具表现力的可控时序生成方式。现有方法要么使用预训练文本编码器的固定嵌入,要么端到端微调编码器,但都未主动将条件表示适配到信号模态,导致引导能力不足。本文提出GALA:生成感知的跨模态对齐方法。该方法分两阶段:首先通过辅助生成损失,将预训练文本编码器与时序基础模型在共享空间中对比对齐并共同优化;随后冻结对齐后的文本嵌入,驱动流匹配生成器。在涵盖四个领域的TSFragment-600K数据集上,GALA在36项指标中30项排名第一,长度24/48/96下的平均排名分别为1.08/1.08/1.42,优于最强基线的1.92/2.00/1.75。进一步发现,内部文本编码器会牺牲保真度以换取文本匹配,而对齐嵌入可同时提升三者。移除辅助生成损失会导致FID、CTTP和JFTSD全面下降,说明生成损失是对齐的核心而非附加组件。

原文摘要 · Abstract (English)

Synthesizing time series from natural language is emerging as the most expressive form of controllable time series generation. However, existing text-conditioned generators either take caption embeddings frozen from off-the-shelf text encoders, or adapt the encoder end-to-end, letting the denoising loss shape the embeddings only as a by-product. In either case, the conditioning representation is never deliberately matched to the signal modality, leaving it ill-suited to guide generation. We address this by introducing GALA: Generation-Aware cross-modaL Alignment for text conditional time series generation. GALA is a two-stage approach that first contrastively couples a pretrained text encoder with a time-series foundation model into a shared embedding space with both encoders adapted to generation by an auxiliary generative loss, and then freezes the resulting caption embedding to drive a flow-matching generator. On TSFragment-600K, spanning four domains and three fragment lengths, GALA sets a new state of the art, ranking first in 30 of 36 metric columns and reaching an average rank of 1.08/1.08/1.42 at lengths 24/48/96 against 1.92/2.00/1.75 for the strongest baseline. We further find that generator-internal text encoders force a trade-off between fidelity and caption adherence, whereas conditioning on the aligned embedding breaks it: FID, CTTP, and JFTSD all improve at once. Ablating the auxiliary loss degrades FID, CTTP and JFTSD together, it indicates the generative term is a necessary component of the alignment rather than an add-on.

时序生成文本对齐生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。