arXiv:2606.16334cs.CV2026-06

测试大模型对时间顺序的理解能力,发现多数模型存在'时间盲区'

Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT

论文配图:Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT
图 1 · 摘自论文原文
  • 构建五个维度的时序推理评测基准CHRONOSIGHT
  • 最佳模型仅达人类性能的45%,显示严重时间感知缺陷
  • 轻量微调可显著提升时序理解,适合关注多模态时间建模的研究者

人类对视觉场景具有天然的时间感知能力,能判断水果是否成熟或腐烂、建筑是否在施工或拆除,以及两张照片间的时间间隔。大视觉语言模型是否具备这种能力仍是未解且重要的问题。本文提出CHRONOSIGHT,一个严格控制的基准,评估五种视觉时序推理能力:序列时间排序(CHRONORANK)、单图阶段定位(CHRONOLOCATE)、两图间时间差估计(CHRONODELTA,对数尺度)、时序反转检测(CHRONOREVERSE)及时间异常识别(CHRONOODD)。该基准涵盖8类过程(生物生长、食物变化、物理风化、建筑施工、环境变迁、人类衰老、天文现象、城市动态),共1000个样本,时间跨度从分钟到千年。评估8个开源视觉语言模型(参数量500M至190亿),在两种提示策略下进行测试,并收集人类基线。人类平均表现0.89,最佳模型Qwen2.5-VL-7B在直接提示下仅达0.40,差距被称为“时间盲区”。在151个样本上进行轻量级LoRA微调后,CHRONODELTA准确率从接近零提升至0.43,并在零样本迁移中实现其他任务(如CHRONOODD: 0.37;CHRONOREVERSE: 0.64)的显著改进,表明瓶颈主要在于指令遵循而非视觉感知。评测数据、代码和预测结果将在论文接收后公开。

原文摘要 · Abstract (English)

Human perception of visual scenes is inherently temporal. We instinctively recognise whether a fruit is ripening or rotting, whether construction is progressing or being demolished, and approximately how much time separates two photographs of the same subject. Whether large vision-language models (VLMs) share this competence remains an open and practically important question. We introduce CHRONOSIGHT, a rigorously controlled benchmark evaluating five dimensions of visual temporal reasoning: CHRONORANK (chronological ordering of image sequences), CHRONOLOCATE (ordinal stage localisation from a single image), CHRONODELTA (estimation of time elapsed between two images on a logarithmic scale), CHRONOREVERSE (detection of temporally reversed sequences), and CHRONOODD (identification of a temporal outlier within a set). The benchmark comprises 1{,}000 items across eight process families (biological growth, food transformation, physical weathering, construction, environmental change, human ageing, astronomical phenomena, and urban dynamics) spanning timescales from minutes to millennia. We evaluate eight open-source VLMs (500 M to 19 B parameters) under two prompting regimes and collect human performance baselines. Human performance averages 0.89 across tasks; the best open model (Qwen2.5-VL-7B) reaches 0.40 under direct prompting, a gap we term chronological blindness. Lightweight LoRA fine-tuning on 151 examples raises CHRONODELTA accuracy from near-zero to 0.43, transferring zero-shot to related tasks (CHRONOODD: 0.37; CHRONOREVERSE: 0.64)suggesting the bottleneck is partly instruction following rather than visual perception. Benchmark, code, and predictions will be released upon acceptance.

时序推理视觉语言模型多模态评测基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。