用合成老化图像补足历史影像缺失,提升文物跨域检索效果
Compensating for Scarce Historical Images in Cross-Domain Cultural Heritage Retrieval Using Synthetic Aging

- 通过退化变换生成合成老照片,替代或补充真实历史图像
- 在25%真实历史数据下,合成数据使检索准确率提升3.69个百分点
- 合成数据主要扩展跨域身份覆盖,适合数据稀缺场景
文化遗产收藏常包含同一实体的当代与历史视觉记录,但因视角、拍摄条件、色彩还原、构图、分辨率和退化差异,图像关联困难,且真实历史图像往往稀缺。本研究探讨使用合成老化当代图像是否可替代或补充缺失的历史训练数据,实现双向实例级检索。采用退化导向变换生成合成旧域图像,以EfficientNetV2-M模型在三个数据集分区及三组训练种子下评估,对比混合真实-合成训练与纯真实基线(按比例缩放与固定300批/周期)。完全替换真实历史图像使双向平均R@1从86.56%降至81.27%,表明合成老化无法复现全部真实旧域变异性;增加独立生成的合成样本未带来稳定提升。但在受控稀缺条件下,合成补全在25%真实覆盖率下使平均R@1提升3.69个百分点,在50%下提升2.92点,75%时降为2.00点,性能仍接近完整真实数据参考。固定周期基线未体现此改进。结果表明,真实与合成观测具有互补性,合成补全主要通过扩展跨域身份覆盖提升检索,其增益随真实历史覆盖率上升而递减。
原文摘要 · Abstract (English)
Cultural heritage collections often contain contemporary and historical visual records of the same physical object. Linking these records is difficult because corresponding images may differ in viewpoint, acquisition conditions, color reproduction, framing, resolution, and degradation, while genuine historical images are frequently scarce. This study investigates whether synthetically aged contemporary images can replace or complement missing historical training data in bidirectional instance-level retrieval. Synthetic old-domain images are generated using degradation-oriented transformations. An EfficientNetV2-M model is evaluated on identity-disjoint training, validation, and test sets across three dataset partitions and three training seeds. Mixed real-synthetic training is compared with real-only baselines using proportionally scaled and fixed 300-batch-per-epoch schedules. Complete replacement of genuine historical images reduced bidirectional mean R@1 from 86.56% to 81.27%, showing that synthetic aging does not reproduce the full genuine old-domain variability. Increasing the number of independently generated synthetic variants provided no consistent improvement. Under controlled scarcity, however, synthetic completion improved mean R@1 by 3.69 percentage points at 25% genuine historical coverage and by 2.92 points at 50%, relative to the proportionally scaled real-only baselines. At 75%, the gain decreased to 2.00 points, while performance remained comparable to the complete-real-data reference. Fixed-schedule real-only controls did not reproduce these improvements. The results indicate that genuine and synthetic observations are complementary. Synthetic completion primarily benefits retrieval by extending cross-domain identity coverage rather than by increasing training exposure, with its contribution gradually decreasing as genuine historical coverage increases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。